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SUMMARY 
Background 

Efficient  and  effective  selection  of  recruiters  is  one  of  the  most 
challenging  tasks  confronting  the  military  services  in  the  All  Recruited  Force 
era.  As  a  declining  youth  population  decreases  the  pool  of  potential  recruits, 
recruiting  is  expected  to  become  more  difficult.  Appropriate  recruiter  selection 
procedures  can  increase  the  likelihood  that  authorized  strength  levels  will  be 
met  in  a  cost-effective  manner. 

The  US  Army  Recruiting  Command  (USAREC)  became  responsible  for  recruiting 
for  the  US  Army  Reserve  (USAR)  in  1979  and  in  1986  had  nearly  1,800  Reserve 
recruiters.  Unlike  its  Active  Army  counterpart,  the  USAR  is  a  geographically 
limited  entity  and  must  structure  its  recruiting  efforts  in  local  markets  to  meet 
the  diverse  personnel  requirements  of  a  large  number  of  geographically  dispersed 
Reserve  units. 

Past  research  indicates  that  two  categories  of  factors  have  been  identified 
for  their  utility  in  predicting  successful  recruiter  performance.  One  category 
includes  biographical  and  personal  history  characteristics  which  are  available  in 
standard  military  personnel  files  while  the  second  group  of  factors  is  comprised 
of  measures  of  behavioral  and  personality  traits.  Neither  set  of  measures  have 
proved  satisfactory  in  predicting  recruiter  success. 
Purpose 

The  purpose  of  this  study  is  to  evaluate  existing  literature  and  data  on 
recruiter  performance  and  characteristics,  to  identify  attributes  associated  with 
successful  recruiters,  and  to  develop  a  model  to  aid  in  the  selection  of 
personnel  who  are  most  likely  to  become  successful  recruiters. 

Traditional  methods  for  identifying  the  personnel  characteristics  which  are 
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associated  with  recruiter  success  rely  on  the  existence  of  reiiabie  and  valid 
measures  of  both  the  relevant  personal  attributes  and  of  recruiter  performance. 
Previous  studies  of  recruiter  productivity  have  suffered  from  an  inability  to 
control  for  differences  in  local  market  factors.  The  "criterion"  problem,  or  the 
lack  of  a  yardstick  that  objectively  measures  recruiter  productivity  has 
prohibited  successful  application  of  conventional  multivariate  statistical 
techniques  to  the  problem  of  identifying  the  relative  importance  of  factors 
affecting  recruiter  success. 
Method 

This  study  applies  a  relatively  new  methodology,  expert  systems,  to  the 
recruiter  selection  problem.  This  technology,  a  branch  of  artificial 
intelligence,  has  proved  particularly  useful  in  dealing  with  problems  involving 
subjective  judgment.  Recruiter  selection  presents  just  such  a  decision  problem. 
An  appropriate  expert  systems  shell  can  be  used  to  develop  a  multiattributc 
utility  model  for  evaluating  recruiter  candidates. 

The  expert  systems  approach  addresses  two  major  shortcomings  of  traditional 
analysis:  the  difficulty  of  specifying  the  relative  importance  of  recruiter 
attributes,  and  the  reliance  on  an  objectively  measured  criterion  for  recruiter 
success. 

Expert  systems  were  developed  for  6  Active  Guard  and  Reserve  (AGR)  Army 
recruiters  and  for  10  Regular  Army  (RA)  recruiters.  In  addition,  composite 
models  were  constructed  for  Reserve  and  Active  recruiters.  The  validity  of  these 
systems  was  evaluated  by  the  expert  systems  program  itself.  All  of  the  systems 
developed  for  recruiters  showed  high  marks  for  all  of  the  internal  tests  of 
validity.  Twenty  hypothetical  recruiter  applicants  were  then  screened  by  each  of 
the  expert  systems  and  a  fairly  consistent  pattern   of  selection  and  rejection 
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emerged. 
Results 

The  characteristics  of  a  successful  recruiter  may  be  inferred  from  the 
weights  assigned  to  individual  attributes  within  the  dimensions  identified  by  the 
expert  systems.  Recruiter  attributes  were  grouped  into  six  dimensions: 
Communication  Skills,  Personality  Characteristics,  Behavior  characteristics, 
Military  background,  Demographic  Characteristics,  and  Specific  Experience.  This 
hierarchy  of  attributes  is  based  on  the  findings  of  previous  studies  and  also 
upon  the  opinions  of  experts  in  the  recruiting  field.  It  includes  both  the 
biodemographic  factors  and  the  personality/behavior  traits  identified  by  earlier 
researchers. 

On  the  whole,  Reserve  recruiters  judged  Communication  Skills,  Demographic 
Characteristics,  and  Personality  Characteristics  to  be  the  most  important 
dimensions  for  successful  recruiting,  while  Active  recruiters  felt  that 
Communication  Skills,  Personality  Characteristics,  and  Behavior  Characteristics 
were  most  important. 

Reserve  recruiter-experts  saw  a  potentially  successful  candidate  as  an 
individual  who  is  intelligent,  persuasive,  self-motivated,  high-ranking  for  his 
or  her  length-of-service,  and  who  has  some  sales  experience.  Active  recruiters 
have  a  similar  ideal  candidate  who  possesses  public  speaking  experience  rather 
than  sales  experience  and  has  many  years  of  service  (Active  Duty)  rather  than 
high  rank,  but  with  otherwise  identical  characteristics.  A  major  benefit  of  an 
expert  systems  approach  is  that  the  derived  models  give  a  role  to  every  attribute 
within  an  extensive  hierarchy  of  attributes  and  develop  an  internally  consistent 
selection  tool  reflecting  all  of  the  characteristics. 


IV 


Recommendat  ions 

The  application  of  expert  systems  technology  to  problems  of  personnel 
selection  is  in  the  very  early  stages  of  development.  The  artificial 
intelligence  field  itself  is  rapidly  advancing  and  promises  to  provide  solutions 
to  many  difficult  questions.  Currently,  however,  there  are  severe  limitations  to 
the  usefulness  of  these  methods  in  solving  so  complex  a  problem  as  recruiter 
selection.  The  model  developed  here  does  succeed,  to  a  great  extent,  in 
assigning  weights  to  personal  attributes  in  an  objective  manner  within  the 
context  of  an  unspecified  criterion  for  recruiter  fu^ess.  It  does  not,  however, 
simulate  the  intricate  processes  of  human  reasoning  which  are  involved  in  the 
selection  of  essential  personnel  by  a  large  organization. 

There  are  several  important  areas  for  future  work.  One  is  the  construction 
of  expert  systems  shells  which  better  suit  the  specific  decision  problem  and  a 
tailoring  of  the  knowledge  acquisition  aspect  of  the  programs  to  suit  the 
recruiter  experts.  A  second  area  for  further  work  is  the  measurement  of 
personality  and  behavior  traits  for  recruiter  candidates  so  that  these  values  can 
be  used  in  testing  expert  systems  models.  A  third  task  is  the  continuation  of 
research  into  the  characteristics  associated  with  recruiter  success.  The 
hierarchies  which  provide  the  basic  structure  for  the  expert  systems  model  must 
come  from  knowledge  of  the  dynamics  of  the  recruiting  process. 
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I .   INTRODUCTION 
A.    Purpose 

Recruiter  selection  is  one  of  the  most  challenging  tasks  confronting  the 
military  services  in  the  All  Volunteer  Force  era.  Recruiting  is  expected  to 
become  more  difficult  as  a  declining  youth  population  decreases  the  pool  of 
potential  recruits.  The  services  not  only  compete  with  each  other  but  will 
continue  to  compete  with  the  civilian  sector  for  qualified  personnel  in  a 
declining  manpower  pool.  Additionally,  budget  constraints  may  severely  limit  the 
resources  available  to  attract  the  necessary  quantity  and  quality  of  new 
enlistees.  As  a  result,  the  services  will  increasingly  need  to  maximize  the 
efficient  selection  and  utilization  of  their  recruiter  manpower.  Effective 
selection  procedures  increase  the  likelihood  that  enough  people  will  be  recruited 
to  meet  authorized  strength  levels,  recruiting  goals,  and  assigned  missions. 

The  costs  of  inappropriate  recruiter  selection  methods  are  considerable  in 
terms  of  both  monetary  and  human  resources.  Poor  recruiter/ job  matches  decrease 
productivity  and  increase  turnover  and  related  costs  resulting  from  moving, 
training,  and  replacing  recruiters  who  are  not  right  for  the  job.  Individuals 
are  usually  selected  for  recruiting  duty  from  among  those  with  high  performance 
ratings  in  previous  assignments  and  if  these  junior  noncommissioned  officers  are 
not  successful  on  recruiting  duty,  their  self-confidence,  attitude,  and 
motivation  are  likely  to  suffer  and  may  lead  to  poor  performance  in  future 
assignments  or  early  attrition. 

The  purpose  of  this  study  is  to  identify  attributes  associated  with 
successful  recruiters,  to  evaluate  existing  data  on  recruiter  performance  and 
characteristics,  and  to  develop  a  model  to  aid  in  the  selection  of  personnel  who 
are  most  likely  to  become  successful  recruiters. 


Chapter  II  discusses  previous  studies  which  have  attempted  to  identify, 
successful  recruiters  and  points  out  the  serious  deficiencies  in  data, 
particularly  performance  measures,  which  have  inhibited  the  development  of  useful 
recruiter  selection  procedures.  Chapter  III  introduces  a  methodology  based  on 
expert  systems  technology  which  is  used  to  overcome  many  of  the  problems 
encountered  in  previous  attempts  to  establish  criteria  for  recruiter  selection 
using  more  traditional  methods.  Chapter  IV  describes  the  characteristics  of  the 
expert  systems  developed  for  Array  Active  and  Reserve  recruiters  and,  from 
interviews  with  16  recruiting  "experts",  investigates  methods  for  deriving 
composite  models,  evaluates  the  expert  systems,  and  discusses  in  detail  the 
dimensions  and  attributes  embodied  in  the  models.  Chapter  V  presents  conclusions 
based  on  the  literature  and  data  review  and  on  the  prototype;  expert  system 
application  as  well  as  recommendations  for  future  work. 
B .   Background 

The  group  of  Reserve  recruiters  investigated  in  the  empirical  portions  of 
this  report  represent  particularly  difficult  selection,  assignment,  and  training 
problems  for  the  Army  Recruiting  Command  (USAREC).  USAREC  first  became 
responsible  for  recruiting  for  the  US  Army  Reserve  (USAR)  in  1979  and  now  has 
nearly  1,800  people  serving  as  reserve  recruiters.  Unlike  its  Active  Army 
counterpart,  the  USAR  is  a  geographically  limited  entity  and  must  structure  its 
recruiting  efforts  in  local  markets  to  meet  the  diverse  personnel  requirements  of 
a  large  number  of  geographically  dispersed  Reserve  units. 

USAR  recruiters  comprise  a  volunteer  force  chosen  by  USAREC  from  a  field  of 
solicited,  qualified  USAR  applicants.  Currently,  the  selection  criteria  for  USAR 
recruiters  are  based  upon  administrative  regulations  and  personal  interviews  or 
references   at   the   recruiting  battalion   level.     USAREC   has   56   recruiting 


battalions  and  other  commands  within  its  organization.  Each  battalion  commander 
is  responsible  for  soliciting  applications  and  conducting  interviews  to  fill  USAR 
vacancies,  most  of  which  are  recruiter  positions.  [Ref.  2]  The  battalion 
commander  selects  or  rejects  an  applicant  and  sends  the  application  to  USAREC  for 
administrative  review.  If  USAREC's  review  is  favorable  the  application  is 
forwarded  to  the  Army  Reserve  Personnel  Center  (APPERCEN)  where  a  final  decision 
is  made.   [Ref.  1;  p.  25] 

The  interview  phase  is  a  very  important  part  of  the  recruiter  selection 
process  and  each  recruiting  battalion  has  the  authority  to  conduct  interviews 
based  on  its  own  rules  and  needs.  The  number  of  board  members  and  their 
composition  can  vary  widely.  There  are  few  guidelines  to  help  board  members  and 
battalion  commanders  in  making  critical  selection  decisions.  A  better  undei — 
standing  of  the  relationship  of  personal  characteristics  and  successful  perfor- 
mance as  a  recruiter  would  make  these  decisions  easier.  In  addition,  a  model  for 
establishing  objective  criteria  for  recruiter  selection  could  provide  a  useful 
structure  for  the  decision  making  process. 


II.   LITERATURE  AND  DATA  REVIEW 

A.   Forward 

All  of  the  military  services  have  studied  ways  to  select  personnel  that  have 
the  highest  likelihood  of  becoming  successful  recruiters.  This  literature  review 
provides  an  overview  of  research  on  the  selection  of  successful  recruiters.  The 
review  includes  discussions  of  methodologies  for  determining  factors  associated 
with  successful  recruiting,  consistency  and  validity  of  results,  commonality  of 
resultant  factors,  limitations  and  problems  encountered,  and  concludes  with  an 
assessment  of  future  research  needs  in  this  area. 

While  all  branches  of  the  military  are  represented  in  the  literature,  Air 
Force  studies  are  outnumbered  by  a  wide  margin.  There  appear  to  be  at  least  two 
reasons.  For  the  first  few  years  after  the  inception  of  the  All  Recruited  Force, 
the  services  fielded  volunteer  recruiter  forces.  Today,  however,  all  active 
services  except  the  Air  Force  rely  on  recruiting  forces  comprising  mainly  non- 
volunteers.  Another  explanation  for  the  Air  Force's  comparatively  small  body  of 
research  on  recruiter  selection  is  that  service's  historic  recruiting  success. 
The  Air  Force  has  been  the  number  one  branch  choice  among  potential  enlistees  for 
decades,  and  the  service  has  met  its  recruiting  goals  with  no  apparent 
difficulty.  Thus,  the  Air  Force  may  not  have  had  as  much  need  to  examine  the 
recruiter  selection  issue. 

Various  methods  have  been  used  to  conduct  research  in  recruiter  selection. 
Most  researchers  used  paper-and-pencil  test  batteries  in  their  attempts  to 
identify  characteristics  of  successful  recruiters  and  predict  recruiter  perfor- 
mance. Other  researchers  used  biographical  information,  structured  and  un- 
structured interviews,  job  analysis,  assessment  centers,  and  other  methods. 


In  general,  the  results  of  previous  studies  have  been  disappointing.  In 
many  studies,  few  results  were  statistically  significant.  In  others,  results 
that  were  significant  had  dubious  meaning  and  were  not  cross-validated.  In  still 
others  when  cross-validation  was  attempted,  original  results  could  not  be 
duplicated. 

Several  common  problems  in  previous  research  help  to  explain  their  disap- 
pointing results.  The  most  common  difficulty  was  the  "criterion  problem": 
measuring  recruiter  performance  in  a  reliable  and  valid  manner.  [Ref.  3;  p.  16 j 
Prior  studies  have  used  a  variety  of  measures  to  attempt  to  capture  recruiter 
performance:  supervisory  ratings,  school  performance,  percent  of  quota  achieved, 
and  total  number  of  recruits  enlisted  have  been  used  as  performance  measures, 
among  others.  Supervisory  ratings  are  often  unreliable  and  of  questionable 
validity.  Even  with  the  best  of  intentions,  supervisors  can  be  influenced  by 
characteristics  unrelated  to  job  effectiveness  ([Ref.  4;  p.  I]).  This  can  lead 
to  evaluations  based  on  reputation  rather  than  performance.  Recruiting  school 
performance  has  limitations  as  a  measure  of  recruiting  performance  since 
graduates  of  recruiting  school  may  perform  differently  in  the  field  than  they  do 
in  training.   [Ref.  5;  pp.  14-16] 

The  greatest  limitation  in  analyzing  characteristics  of  successful 
recruiters  is  the  inability  of  recruiter  production  concepts — such  as  percent  of 
quota  achieved  and  total  number  of  recruits  enlisted — to  provide  a 
straightforward  measure  of  success  of  an  individual  recruiter.  Recruiter 
production  figures  that  do  not  account  for  market  effects  or  "opportunity  bias" 
(the  relative  ease  or  difficulty  in  obtaining  enlistments  in  a  particular  market) 
cannot  provide  a  basis  for  examining  variations  in  productivity  due  to 
differences  in  individual  recruiters.   A  recruiter's  successful  production  might 


be  the  result  of  having  been  assigned  to  a  fertile  recruiting  territory.  The 
studies  using  recruiter  performance  as  a  criterion  measure  and  personnel 
characteristics  as  explanatory  factors  have  universally  been  inadequate  in  their 
incorporation  of  market  factors  for  explaining  variation  in  recruiter 
performance.  Such  omitted  variable  approaches  yield  results  that  inaccurately 
associate  variation  in  recruiter  performance  to  variation  in  personnel 
characteristics.  Limited  information  about  the  recruiter's  job  reduced  the 
usefulness  of  some  of  the  earlier  research.  Later  studies  benefitted  from 
information  collected  through  job  analysis  [Ref.  7], 

Appropriate  consideration  of  the  selection  environment  is  a  necessary 
consideration  in  recruiter  selection.  The  number  of  recruiters  selected  in- 
voluntarily varies  by  branch  of  service.  The  Air  Force  is  currently  the  only 
service  whose  active  duty  recruiters  are  all  volunteers.  Selection  procedures 
also  vary  within  a  service.  For  example,  nearly  all  of  the  Army's  Active  Guard 
and  Reserve  (AGR)  recruiters  are  volunteers,  yet  most  recruiters  who  enlist 
people  into  the  Regular  Army  are  non-volunteers.  Since  most  active  duty 
recruiters  are  now  selected  involuntarily,  recent  research  has  attempted  to 
identify  reliable  recruiter  selection  methods  that  would  not  be  vulnerable  to 
compromise  or  "faking,"  as  are  test  batteries.  These  problems  with  test 
batteries  have  amplified  interest  in  passive  methods  using  demographic, 
biographical,  and  military  experience  data  the  services  maintain  routinely  in 
various  data  banks.  Unfortunately,  the  inability  to  determine  adequately  the 
relative  importance  of  background  and  personality  factors  has  severely  limited 
the  payoff  from  the  use  of  such  passive  methods. 

This  section  discusses  relevant  studies  attempting  to  identify  character- 
istics of  successful  recruiters.    The  studies  are  organized  by  the  source  of 


information  used  to  identify  successful  recruiters:   interviews,  test  batteries, 

assessment  centers,  and  personnel  file  data.   Unless  particularly  relevant,  older 

studies  are  discussed  fairly  briefly.   More  recent  work  is  discussed  in  greater 

detail. 

B.   Interviews 

1.  Borman,  Hough,  and  Dunnette 

In  1976,  Borman,  Hough,  and  Dunnette,  at  the  Naval  Personnel  Research 
and  Development  Center  (NPRDC)  attempted  to  develop  behaviorally-based  rating 
scales  to  evaluate  the  performance  of  Navy  recruiters  [Kef .  6] .  They  believed 
that  an  extensive  analysis  of  the  recruiter  job  would  be  required  before  any 
further  research  on  recruiter  selection  could  be  accomplished.  To  become 
familiar  with  the  recruiter  job,  recruiters,  supervisors,  and  recruits  were 
interviewed.  During  two  days  of  workshops,  more  than  800  critical  incidents 
(examples  of  recruiter  performance)  describing  effective  and  ineffective 
recruiting  performance  were  obtained  from  field  recruiters  from  all  Navy 
Recruiting  Areas.  Another  135  performance  examples  were  solicited  from  Navy 
recruits  during  interviews  at  boot  camp.  NPRDC 's  1976  study  was  the  springboard 
for  three  additional  studies  conducted  over  the  past  ten  years.  These  studies 
are  discussed  in  the  section  on  test  batteries. 

2.  Borman,  Toquam  and  Posse 

Borman,  Toquam  and  Posse's  1977  Army  Research  Institute  study  echoed 
the  1976  NPRDC  study,  hypothesizing  that  a  reason  why  paper-and-pencil  predictors 
of  Army  recruiter  effectiveness  had  met  with  such  little  success  was  that  not 
enough  was  known  about  the  performance  requirements  of  the  recruiter  job  [Ref. 
7] .  This  study  focused  on  discovering  these  performance  requirements  by 
attempting  to  define  the  underlying  task  dimensions  associated  with  Army 


recruiter  and  guidance  counselor  jobs. 

The  first  step  was  to  revise  an  existing  Department  of  the  Army  task 
list  that  described  Military  Occupational  Specialty  (MOS)  designator  00E.  Array 
recruiters  and  guidance  counselors  share  this  MOS  because  their  jobs  are  similar. 
The  recruiter's  job  is  to  qualify  prospective  applicants.  The  guidance 
counselor's  task  is  to  convince  them  to  accept  a  particular  entry  level 
assignment.  After  a  pilot  test,  the  revised  task  inventory  was  administered  to 
101  field  recruiters,  guidance  counselors,  and  supervisors  across  all  five 
recruiting  regions.  These  experts  sorted  the  tasks  into  groups,  or  dimensions, 
according  to  the  tasks'  perceived  similarity  with  respect  to  job  function. 
Participants  worked  on  their  own,  each  sorting  task  statements  into  categories. 

Before  analyzing  the  data,  researchers  tested  the  extent  of  agreemenl 
in  solutions  by  dividing  participants  into  various  subgroups:  recruiter  and 
guidance  counselor  groups,  District  Recruiting  Command  (DRC)  subgroups 
(currently,  Command  Leadership  Teams),  etc.  Once  consistency  in  responses  across 
subgroups  was  established,  the  data  were  collapsed  across  all  subjects  and 
analyzed.  The  two  types  of  analyses  performed  were  multidimensional  scaling 
(MDS)  and  a  clustering  procedure. 

Results  indicated  that  people  in  the  different  DRCs  agreed  substan- 
tially among  themselves  about  the  pattern  of  similarities  among  tasks.  Guidance 
counselors  and  recruiters  agreed  closely,  and  supervisory  personnel  saw  much  the 
same  pattern  of  task  similarities  as  those  they  supervised.  Since  no  serious 
disagreements  in  responses  existed,  the  solutions  were  collapsed  across  the 
entire  sample,  and  a  summary  list  of  task  dimensions  was  formed  (Table  1).  This 
composite  list  contained  four  broad  dimensions  defining  general  task  areas 
associated  with   the   recruiter's   and  guidance  counselor's   role   in  the  Army 
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recruitment  process. 

Borman  et  al.,  believed  these  dimensions  could  be  useful  in  developing 
selection  procedures  for  potential  Army  recruiters.  They  believed  the  content  of 
the  dimensions  would  suggest  the  types  of  personal  characteristics  and  attributes 
necessary  for  effective  recruiter  performance.  Then,  paper-and-pencil  measures 
of  these  attributes  could  be  chosen  or  developed  as  indicators  of  potential  for 
top-level  performance  in  Army  recruiting  work.  The  authors  also  suggested  that 
the  dimensions  could  serve  as  performance  rating  scales  in  future  selection 
research  intended  to  ensure  that  selection  procedures  chosen  were,  in  fact, 
validly  identifying  persons  with  good  potential  for  Army  recruiting.1 
3.    Graham,  Brown,  King,  White,  and  Wood 

Graham,  Brown,  King,  White  and  Wood's  1979  Array  Research  Institute 
study  described  structured  interviews  conducted  with  79  Army  recruiters  to  obtain 
information  on  the  nature  of  recruiting  duty  [Ref.  8] .  The  sample  was  selected 
to  represent  recruiters  with  high,  medium  and  low  records  of  success,  in  terms  of 
percentage  of  quota  achieved.  Information  collected  from  the  interviews  was  used 
to  develop  hypotheses  on  the  personal  characteristics  and  job  behaviors  assoc- 
iated with  recruiter  success.  These  hypotheses  were  to  be  evaluated  more 
rigorously  in  later  research. 

Interviews  solicited  the  following  types  of  information  from 
recruiters:  background  characteristics,  suggestions  about  recruiter  training, 
the  value  of  various  prospecting  and  selling  techniques,  workload,  attitudes 


1  This  study  did  not  identify  personal  characteristics  and  attributes  of 
successful  Army  recruiters;  however,  Borman  is  currently  working  on  a  project  to 
develop  performance-based  rating  scales  for  Army  recruiters  similar  to  work  he 
did  for  the  Navy  in  1976  (telephone  discussion  November  1986). 


Table  1.   Composite  list  of  recruiting  task  dimensions 
I.   Prospecting  activities 

Identifying  and  contacting  qualified  prospects 

using  existing  name  sources  to  generate  Lists  of  prospects 

-  contacting  prospects 

dealing  with  centers  of  influence  and  other  persons  in  the  schools  and  in 
the  community  for  the  purpose  of  gathering  prospect  names 

-  obtaining  referrals 

II.   Publicizing  the  Army 

Building  a  positive  Army  image  in  the  community  by  setting  a  good  example  and  by 
providing  favorable  publicity  for  the  Army  and  Army  enlisted  programs. 

conducting  Army  publicity  programs  in  the  schools  or  in  the  community 

-  working  with  the  news  or  other  media  to  obtain  favorable  publicity  for  the 
Army 

performing  community  services  and  working  with  community  groups   to  enhance 
the  Army's  image 

preparing  and  delivering  presentations  about  the  Army  to  civic 
organizations,  at  career  counseling  sessions,  or  at  recruiting  seminars 

III.   Selling  the  Army 

Getting  individuals  to  join  the  Array  by  counseling  them,  explaining  army  benefits 
and  opportunities  to  them,  and  presenting  the  advantages  of  Army  life. 

describing  aspects  of  Army  life,  benefits  and  opportunities  to  prospects 

-  conducting  interviewing  or  counseling  sessions  with  prospects  to  sell  them 
on  the  Array 

answering  questions   about  the  Army  and  about  enlistment;   overcoming 
objections  to  joining  the  Army  service 

-  sizing  up  individual  prospects  and  tailoring  the  interview  to  help  sell  Army 

IV.   Administrative  activities 

Working  with  recruiting  reports,   records,   statistics,   etc. ,   and  organizing 
recruiting  activities. 

-  preparing,  maintaining,  and  reviewing  enlistment  reports 

planning  recruiting   activities:     performing  market   research,   zoning 

recruiting  areas,  etc. 

maintaining  recruiting  statistics  and  records 

-  maintaining  recruiting  publications 

Source:    Borman,  W.C. ,   Toquam,  J.L.,   and  Rosse,   R.L.,  Dimensions   of  the  Army 
Recruiter  and  Guidance  Counselor  Job. 
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toward  the  job,  personality  characteristics  that  might  be  related  to  recruiter 
effectiveness,  and  descriptions  of  successful  and  unsuccessful  recruiters. 

Responses  were  coded,  categorized,  and  analyzed  to  determine:  (.1) 
personal  characteristics  and  job  behaviors  related  to  recruiter  production 
records  and  (2)  personal  characteristics  and  job  behaviors  attributed  (by  the 
respondents)  to  successful  and  unsuccessful  recruiters  they  knew. 

The  criterion  used  as  a  productivity  measure  was  the  percentage  of  the 
total  non-prior  service  (NPS)  quota  achieved  in  a  six-month  period.  The  authors 
realized  the  limitations  of  this  measure,  but  felt  it  was  the  best  obtainable 
within  their  time  and  resource  constraints. 

Recruiters  were  placed  into  criterion  groups  of  high,  medium  and  low 
producers  based  on  production  data.  During  the  interviews,  each  recruiter  was 
asked  to  think  of  one  successful  and  one  unsuccessful  recruiter  he  knew  and 
answer  questions  about  the  two  recruiters'  work  attitudes,  job  skills,  persona- 
lity traits,  etc.  Interview  responses  were  coded  into  broad  categories.  Rela- 
tionships between  interviewee  responses  and  their  production  records  were 
explored  in  two  ways: 

a.  Comparison  of  high  and  low  producers  (chi  square  test).  The 
authors  hypothesized  that  high  and  low  producers'  scores  could 
differ  significantly  in  many  categories. 

b.  Correlations  between  presence  in  a  category  and  production  records 
Each  recruiter  was  assigned  a  score  of  0  or  1  based  on  whether  or 
not  he  was  described  by  a  response  within  that  category.  Category 
scores  were  correlated  with  the  production  criterion  to  determine 
relationships  between  response  categories  and  the  criterion. 

The  authors  believed  many  recruiters'  responses  were  actually  elements 
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in  a  stereotype  of  the  good  recruiter,  which  they  may  have  acquired  in  training 
or  elsewhere,  and  not  based  on  actual  observations  of  the  respondent.  As 
indicated  by  Graham,  et.al,  peer  nomination  data  should  be  regarded  as 
recruiters'  opinions  of  what  it  takes  to  be  a  good  recruiter  rather  than 
descriptions  of  good  and  poor  recruiters.  The  recruiters'  conceptions  of  the 
successful  and  unsuccessful  recruiter  are  presented  in  Table  2. 

Few  of  the  characteristics  in  the  self-description  data  were  signi- 
ficantly related  to  production  records.  Some  of  the  study's  results  are  listed 
here. 

a.  Attitudes  Toward  the  Job  -  "Likes  independence"  correlated 
significantly  and  negatively  with  job  success  (r  =  -.24)  sug- 
gesting that  high  producers  were  less  likely  than  low  producers  to 
cite  "independence"  as  a  source  of  job  satisfaction.  Recruiters 
who  commented  on  their  dislike  of  "long  hours,"  "the  frustrating 
nature  of  the  job,"  etc.,  tended  to  be  more  productive  than  those 
who  did  not  make  those  comments. 

b.  Prospecting  Techniques  -  According  to  successful  recruiters,  this 
is  one  of  the  most  important  components  of  the  job.  The  objective 
is  to  bring  the  recruiter  into  direct  personal  contact  with 
potential  enlistees.  Successful  recruiters  emphasized  that  they 
spent  many  hours  daily  in  prospecting  activities.  Two  response 
categories.  "Uses  systematic  approach"  and  "Uses  Pre- induction 
physical  cards,  mail-outs,  etc."  were  statistically  significant. 

c.  Selling  Techniques  -  The  ability  to  motivate  a  person  to  enlist  is 
believed  to  be  an  important  characteristic  of  the  successful 
recruiter.  Yet  none  of  the  selling  techniques  mentioned  by 
recruiters  interviewed  were  significant. 
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Table  2.   Characteristics  differentiating  successful  and  unsuccessful 

recruiters:   peer  nomination  data 

Nominees 
( in  percent) 
Successful    Unsuccessful 
N  =  79         N  =  79 
Category 

Motivations  for  becoming  a  recruiter 

Dislike  for  present  assignment  9         43 

Attitudes  toward  the  job 

Likes  the  work 

Likes  the  challenge  of  the  job 
Dislikes  the  high  pressure 
Dislikes  other  features 
Wants  another  type  of  duty 

Prospecting  techniques 

Uses  systematic  approach 

Stresses  person-to-person  contact 

Uses  high  school  CIs 

Uses  other  CIs 

Uses  PIP  cards,  mail-outs,  etc. 

Becomes  involved  in  community 

Passively  waits  for  prospects  to  walk  in 

Emphasizes  peripheral  duties 

Emphasizes  outside  interests 

Selling  techniques 

Uses  miscellaneous  effective  sales  techniques  24         4 

Uses  miscellaneous  ineffective  sales  techniques  0  11 

Communication  skills 

Is  able  to  communicate  effectively  39         14 

Has  difficulty  in  communicating  effectively  0  18 


Indus triousness 

Has  high  achievement  motivation 

Has  low  achievement  motivation 

Is  very  conscientious 

Is  careless  about  details 

Seeks  ways  to  improve 

Keeps  informed  on  everything  related  to  job 
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Table  2.  (continued) 


Characteristics  differentiating  successful  and  unsuccessful 
recruiters:   Peer  nomination  data 


Category 


Friendly,  easygoing 

Outgoing 

Sympathetic 

Stable 

Happy,  humorous 

Light-hearted 

Sincere 

Withdrawn 

Shy,  self-conscious 

Lacks  self-discipline 

Has  family  problems 

inconsistent 

Hostile 

Emotionally  immature 

Resentful,  rebellious 


Nominees 

(in  percent) 

Successfull  Unsuccessful 

N  =  79  N  =79 


Miscellaneous  Personality  Traits 


53 

44 

20 

13 

11 

10 

10 

1 

1 

1 

1 

0 

0 

0 
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4 

0 

0 

0 

0 

0 

1 

17 

17 

14 

13 

14 

13 

10 

10 


Source:    Graham,  W.R.,  Brown,  G.H.,  King,  William  L. ,  White,  L. ,  and  Wood,  M.D. 

A  Pilot  Study  of  Army  Recruiters: Their   Job  Behaviors   and  Persona 

Characteristics. 
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d.  Communications  Skills  -  A  highly  successful  recruiter  must  be  able 
to  communicate  effectively.  One  category,  "has  difficulty 
communicating  effectively"  correlated  negatively  and  significantly 
with  the  production  criterion.  Thus,  high  producers  admitted 
having  communication  problems  less  often  than  low  producers. 

e.  Industriousness  -  The  pilot  study  did  not  reveal  much  infor- 
mation in  support  of  the  idea  that  hard  work  is  essential  for 
successful  recruiters.  Although  several  recruiters  described 
themselves  as  "motivated"  or  as  "self-starters."  These  responses 
were  not  significantly  related  to  high  or  low  production.  Only 
one  response  category,  "keeps  informed  on  everything  relevant  to 
job,"  differentiated  significantly  between  high  and  low  producers. 

f.  Miscellaneous  Personality  Traits  -  "Erapathetic"  correlated 
negatively  and  significantly  with  the  production  criterion.  The 
authors  suggested  that  empathy  seemed  to  be  a  highly  valuable 
characteristic  for  a  recruiter,  yet  it  correlated  negatively  with 
success.  McHurry  suggested  that  high  empathy  may  be  a  handicap  to 
a  salesperson  unless  it  is  accompanied  by  a  strong  ego  drive  or 
will  to  win  [Hef.  8;  p.  21] . 

Some  questions  in  the  interview  asked   the   recruiters   for   their  opinions 

about  selection   criteria  for   recruiters.   A  summary  of  responses  the  recruiters 

mentioned  most  often  and  the  percentage  of  those  responding  appears  in  Teibie  3. 


Table  3.   Recruiter's  opinions  regarding  recruiter  selection 


Response  Percentage 

Should  be  able  to  talk  to  people  49 

Should  have  well-groomed  appearance  33 

Should  want  to  do  the  job  30 

Screen  for  quality  of  past  performance  28 

Should  have  "substantial"  length  of  service  24 

Should  enjoy  working  with  people  20 

Should  be  stable  in  finances  16 

Should  have  sales  experience  13 

Tell  them  what  recruiting  is  really  like  11 

Provide  two  months  of  OJT  11 

Should  be  outgoing  10 

Should  be  adaptable  3 


Source:  Graham,  W.R.,  Brown,  G.H.,  King,  William  L. ,  White,  L. ,  and  Wood,  M.D.,  A 
Pilot  Study  of  Army  Recruiters:  Their  Job  Behaviors  and  Personal  Characteristics . 
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4.    Hirabayashi  and  Hersch 

Hirabayashi  and  Hersch' s  1985  effort  at  the  Naval  Postgraduate  Schoo 
attempted  to  document  characteristics  of  excellent  Navy  Recruiting  District 
[Ref.  9J .  The  authors  visited  and  interviewed  key  individuals  assigned  to  thes 
and  other  Navy  recruiting  activities.  Interviews  were  representative  of  the  Nav 
Recruiting  Command:  current  and  previous  Recruiting  Command  commanders 
commanding  officers,  executive  officers,  department  heads,  recruiters 
recruiters'  supervisors,  trainers,  and  more.  Based  on  the  results  of  thei 
interviews,  the  following  list  summarizes  the  characteristics  of  successful 
recruiters. 
Successful  Navy  Recruiters: 

are  movers,  shakers,  and  salesmen 

are  hungry  for  success  and/or  promotion 

-  are  aggressive,  want  responsibility,  and  want  to  excel 

-  possess  outstanding  communications  skills,  a  fundamental  knowledge  o 
recruiting,  and  an  inherent  ability  to  deal  with  numbers,  sales,  an 
the  public 

are  ambitious,  extroverted,  and  like  to  meet  and  talk  to  people 
are  positive,  cheerful,  enthusiastic,  and  self-motivated. 

C.    Test  Batteries 

1.    Wollack  and  Kipnis 

One  of  the  earliest  developments  of  a  test  battery  for  recruite 
selections  was  a  1960  effort  by  Wollack  and  Kipnis  at  the  Naval  Research  Fiel 
Activity  [Ref.  10).  The  battery's  thirteen  tests  and  inventories  measure 
fluency  of  expression,  knowledge  of  the  Navy,  interest  in  recruiting  activities 
and  general  aptitude. 
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The  study  used  commanding  officers'  nominations  of  effective  and  inef- 
fective recruiters  as  the  criterion  measure  of  performance.  Items  that  dif- 
ferentiated between  effective  and  ineffective  recruiters  beyond  the  .20  confi- 
dence level  were  retained  for  cross-validation. 

Although  few  of  the  battery's  items  and  scales  cross-validated  signi- 
ficantly, the  study's  results  suggested  that  inventories  showed  promise  as 
indicators  of  recruiter  effectiveness.  As  suggested  by  Borman  the  poor  cross- 
validation  results  may  have  occurred  because  raters  made  their  evaluations  of 
recruiters  based  on  reputation  instead  of  performance  or  because  many  of  the 
individual  differences  that  predict  recruiter  success  were  not  included  in  the 
battery.   [Hef.  3;  p.  4]. 

2.  Massey  and  Mull ins 

Massey  and  Mullins  conducted  an  Air  Force  study  in  1966  to  design  and 
validate  the  Recruiter  Salesman  selection  test.  They  developed  an  eight 
inventory  battery  to  measure  qualities  such  as  empathy,  sergeancy  (friendliness 
and  sociability),  and  perseverance  which  were  hypothesized  to  be  desirable  in 
recruiters. 

Predictor  variables  were  correlated  with  school  success  and  supervisor 
field  ratings.  Results  after  crossvalidation  indicated  that  the  battery  would  be 
useful  only  marginally  in  predicting  school  performance  and  not  at  all  In 
predicting  field  ratings.  The  authors  believed  the  supervisor  rating  criterion 
had  caused  the  poor  results,  suggesting  that  it  was  contaminated  by  several  rater 
errors  such  as  "halo"  and  "leniency."  effects.  They  advocated  the  development  of 
a  more  reliable  and  valid  measure  of  recruiter  effectiveness. 

3.  Krug 

In  Krug's  1972  study  for  the  Navy  Recruiting  Command,    a  personality 
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test  was  developed  and  administered  to  officer  and  enlisted  Navy  recruiters  t 
determine  its  usefulness  in  predicting  sales  ability  [Ref.  12).  The  test,  16PF 
m,  was  a  variation  of  the  16PF,  a  highly  regarded  personality  inventory  wide] 
used  by  business  and  industry  in  sales  selection  fRef .  13;  p.  22] . 

in  addition  to  the  1967  version  of  the  16PF  questionnaire,  the  16PF- 
included  a  supplement  designed  to  measure  motivational  distortion  (a  lie  scale 
and  strength  of  motivation  to  succeed  as  a  recruiter,  and  seven  biographic! 
items:  years  of  service,  age,  sex,  marital  status,  number  of  dependents,  year 
of  formal  education,  and  population  of  subject's  Home  of  Record. 

Commanding  officers'  nominations  of  recruiters  from  the  top  and  bottc 
fifty  percent  of  those  on  recruiting  duty  at  the  time  were  used  as  the  criteric 
measure  of  performance.  Stepwise  multiple  regression  results  indicated  that  tl 
typical  effective  Navy  recruiter  was  married,  had  more  years  of  formal  education 
and  tended  to  be  warm,  outgoing,  dominant,  aggressive,  and  self-assured,  wit 
relatively  conservative  political  views. 

The  Navy  Recruiting  Command  used  this  battery  to  screen  people  fc 
recruiting  assignments  for  approximately  four  years  between  1972  and  1976 
Active  duty  Navy  personnel  took  the  test  if  they  were  being  considered  for 
recruiting  assignment.  Those  who  scored  below  thirty-five  were  considers 
unqualified  for  recruiting  duty.  (A  score  of  sixty-five  was  recommended  by  th 
study  team  and  was  predicted  to  be  seventy-two  percent  accurate.  but  the  Nav 
Recruiting  Command  chose  to  use  a  score  of  thirty- five. )  Use  of  the  test  wa 
discontinued  when  Navy  Recruiting  Command  and  the  Chief  of  Naval  Personnel  (Per 
502)  agreed  it  did  not  predict  sales  ability  effectively  [Ref.  13;  p.  24]. 
4.    Arima 

In  his  1976  Navy  Postgraduate  School  study,  Arima  evaluated  the  16PF  a 
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having  little   utility  in   the  selection  process  due  to  the  absence  of  a  reliable 

and  valid  criterion  [Ref.   14].    He  called  for  job  analysis  and  behaviorally- 

anchored  rating  scales. 

The  development  of  a  recruiter  selection  procedure  must  be  preceded  by  a 
thorough  analysis  of  the  position  that  will  show  the  functions  performed  and 
the  relative  importance  of  the  functions.  It  will  also  be  necessary  to 
obtain  knowledge  as  to  the  types  of  behavior  that  are  necessary  to  carry  out 
these  functions  successfully  and  the  types  of  behavior  that  are  detrimental. 
There  is  nothing  new  in  this  approach  to  developing  behavioral ly  anchored 
rating  scales  which  could  provide  the  desired  list  of  behaviors.  Knowledge 
of  the  job  should  provide  the  material  to  develop  a  recruiter  selection 
procedure.   [Ref.  14:p.  129]. 

5 .  Larriva 

Larriva  applied  the  16PF-m  to  a  sample  of  Marine  Corps  recruiters  in  a 
concurrent  validity  study  in  1975  [Ref.  15] .  Annual  non-prior  service  accessions 
were  used  as  the  criterion  measure  of  performance.  The  test  did  not  predict 
well,  and  Larriva  suspected  the  criterion  he  used  had  caused  the  problem.  He 
experimented  with  several  performance  indices,  examined  predictor  criterion 
relationships,  and  chose  the  index  that  resulted  in  the  most  valid  multiple 
correlation  coefficient.  This  index  separated  urban  and  rural  recruiters  and 
corrected  for  geographic  differences  in  relative  performance  of  recruiters. 
Cross-validation  suggested  the  16PF-m  might  be  useful  in  screening  for  the  Marine 
Corps  recruiter  job  [Ref.  3;  p.  8J . 

Borman  et  al.  objected  to  Larriva' s  method  of  criteria  selection, 
indicating  that  a  more  acceptable  (and  justifiable)  method  would  have  been  to 
define  a  precise  criterion  first  and  then  select  a  measure  that  would  provide; 
relevant  and  reliable  measurement  of  the  criterion  without  regard  to  the 
predictors  [Ref.  3;  p.  9|. 

6.  Abrahams,  Neumann,  and  Rimland 

Abrahams,  Neumann,  and  Rimland  used   the  Strong   Vocational  Interest 
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Blank  (SV.IB)  in  1973  to  develop  a  Recruiter  Interest  Scale  (HIS)  for  use  I 
selecting  Navy  recruiters.  Items  that  differentiated  between  the  most  and  leas 
effective  recruiters,  based  on  commanding  officers'  nominations,  comprised  tl 
RIS-1,  which  was  used  for  cross-validation.  The  top  quartile  (highest  Rl! 
scores)  contained  three  times  as  many  effective  recruiters  as  did  the  bottoi 
quartile.  The  bottom  quartile  had  three  times  as  many  ineffective  recruiters  I 
the  top  quartile.  Although  the  authors  stressed  that  a  better  criterion  o 
recruiter  effectiveness  was  needed  and  that  other  recruiter  performance  factor; 
should  be  considered  in  future  validity  research,  their  study  suggested  tha 
vocational  interests  might  successfully  predict  recruiter  effectiveness.  [Ref 
I6J 

7.  Graf  and  Brower 

In  1976,  Graf  and  Brower  also  had  some  success  with  a  version  of  th 
Navy  RIS  modified  for  Marine  Corps  recruiters.  Although  the  Marine  Corpi 
Recruiter  Interest  Scale  (MCRIS)  resulted  in  a  higher  validity  coefficient  thai 
the  Navy  scale  for  the  Marine  Corps  sample,  the  MCRIS  was  not  cross-validated 
which  made  direct  comparisons  impossible.  Although  the  authors  had  use 
recruiting  officers'  nominations  of  above-average,  average,  and  below  averagi 
recruiters  as  their  criterion  measure,  they  called  for  a  more  reliable  method  o 
measuring  recruiter  performance  [Ref.  17] . 

8.  Borman,  Hough,  and  Dunnette 

The  most  extensive  work  in  this  area  was  a  test  battery  developed  b; 
the  Navy  Personnel  Research  and  Development  Center  (NPRDC).  This  work  ha: 
evolved  through  four  studies  over  the  past  ten  years. 

NPRDC 's  work  began  with  the  development  of  behavioral ly-based  ratinj 
scales  which  attempted  to   identify  improved  performance  criteria  for  measurinj 
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recruiter  effectiveness.  The  approach  was  based  on  the  notion  that  acquiring 
valid  information  about  recruiter  effectiveness  meant  that  a  thorough  job 
analysis  and  criterion  development  effort  would  have  to  be  accomplished.  Their 
first  study,  published  in  1976,  identified  more  than  800  critical  incidents 
describing  different  facets  of  effective  and  ineffective  recruiter  performance. 
The  study's  suggested  predictors  of  Navy  recruiter  effectiveness  are  shown  in 
Table  4.   [Hef.  6] 

The  second  phase  of  NPRDC's  research  involved  development  and 
validation  of  an  inventory  battery  to  predict  Navy  and  Marine  Corps  recruiter 
performance.  Based  partly  on  their  literature  review  and  the  results  of  their 
rating  scales  study,  they  developed  a  trial  predictor  battery  that  included 
several  personality,  vocational  interest,  and  biographical  items  and  scales. 
Battery  scores  were  correlated  with  performance  scores  developed  from 
supervisory,  peer,  and  self  ratings  and  from  six  months  of  adjusted  production 
data.  They  attempted  to  control  for  differences  in  recruiting  opportunity  across 
geographical  locations  (opportunity  bias).  Standard  scores  were  developed  for 
each  recruiter  for  each  month  by  standardizing  each  month's  production  data 
within  each  Navy  Recruiting  District  (NRD). 

NPRDC's  third  study  was  designed  to  expand  and  refine  the  original  test 
battery  and  determine  its  validity  in  predicting  recruiter  performance.  The 
revised  battery  was  analyzed  to  determine  the  precision  of  new  items  in  measuring 
desired  constructs  and  whether  they  had  improved  the  validity  of  the  original 
test  battery.  Composites  of  the  added  items  enhanced  the  validity  of  the  old 
battery's  constructs  in  about  half  the  cases.  Scales  derived  from  the  constructs 
validly  predicted  recruiter  effectiveness  [Ref.  18]. 

NPRDC's  final  Special  Assignment  Battery  consisted  of  three  parts:   the 
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Strong-Campbell  Interest  Inventory,  a  self-description  inventory,  and  a 
background  questionnaire.  Recruiter  potential  was  measured  through  a  select ior 
composite  composed  of  four  subscales:  selling  skills,  human  relations  skills, 
organizing  skills,  and  overall  performance.  Scores  on  each  of  these  four 
"keys"  were  correlated  with  each  recruiter's  production  data.  As  indicated  ir 
Table  5  each  of  the  "keys"  had  low  correlations  with  production.  The  correlatiot 
between  production  and  organizing  was  not  significantly  different  from  zero. 
When  the  four  separate  scores  were  summed  into  a  composite,  the  correlatior 
coefficient  between  the  composite  and  production  was  .27.  Figure  1  depicts  the 
pattern  of  these  relationships.  Sixty-six  percent  of  the  recruiters  scoring  ir 
the  top  20  percent  were  in  the  upper  50  percent  in  production,  compared  to  34 
percent  of  those  scoring  in  the  lowest  20  percent. 


Tcible  5.   Validity  of  final  keys  for  predicting  production 

(N  =  194) 

Predictor  key  Correlation  with  production 

Selling  skills  .22* 

Human  relations  skills  .23* 

Organizing  skills  .13* 

Overall  performance  .26* 


p  <  .01 


Source:    Borman,  W.C.,  Rosse,  R.L.,  and  Toquam,  J.L.,  Development  and  Validation 
of  a  Recruiter  Selection  Battery. 
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Figure  1  Percent  successful  recruiters  expected  where  upper  50  percent  are 
considered  successful.  Source:  Borman,  W.C.,  Rosse,  R.L. ,  and  Toquam, 
J.L.,  Development  and  Validation  of  a  Recruiter  Selection  Battery. 
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Several  personality  constructs  correlated  highly  with  various  aspects 
of  recruiter  effectiveness.  "Making  a  good  impression"  and  "Enjoying  being  the 
center  of  attention"  correlated  highest  with  selling  skills.  "Spontaneity, 
impulsivity"  and  "Ambitious,  working  hard"  correlated  highest  with  the  humar 
relations  skills  category,  while  "Unhappy,  lack  of  confidence"  related  negativelj 
to  human  relations  effectiveness.  "Order,  planning  ahead"  related  well  t< 
organizing  skills,  and  "Leading  and  influencing  others"  was  the  construct  thai 
correlated  most  highly  in  the  overall  performance  category.  The  vocational 
interest  constructs  that  correlated  highly  with  performance  criteria  were 
interests  in  extroverted,  dominant,  social,  and  leadership  activities  anc 
occupations,  interests  in  sports  and  competitive  activities,  and  interests  in  lav 
and  political  activities. 

The  fourth  phase  of  NPRDC's  work,  published  in  1985,  strongly  confirmee 
the  findings  of  the  earlier  studies.  In  concurrent  and  predictive  studies, 
Marine  Corps  recruiters  whose  scores  were  in  the  top  20  percent  obtained  27  anc 
40  percent  more  recruits,  respectively,  than  recruiters  who  scored  in  the  lowest 
20  percent.   [Ref.  19]  . 

9.    Brown,  Wood,  and  Harris 

The  1978  study  conducted  by  Brown,  Wood,  and  Harris  at  the  Arm> 
Research  Institute  attempted  to  (1)  develop  a  valid  criterion  of  recruiter 
effectiveness  and  (2)  develop  a  test  battery  to  identify  those  most  likely  tc 
succeed  as  recruiters  [Ref. 5].  This  study  explored  in  some  depth  the  criterion 
problem  of  using  production  scores  contaminated  by  opportunity  bias  caused  by 
characteristics  that  influenced  the  fertility  of  a  recruiting  territory  but  were 
outside  the  recruiter's  control. 

This  ARI  study  identified  15  factors  that  might   cause  opportunity  bias 
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such  as  the  unemployment  rate  in  Lhe  territory,  average  number  of  enlistments  per 
recruiter  in  the  recruiter's  District  Recruiting  Command  (DRC),  amount  of 
recruiting  experience,  etc.  A  sample  of  500  recruiters  was  chosen  randomly,  100 
from  each  of  five  Army  Regional  Recruiting  Commands  nationwide.  Six  months' 
production  figures  were  provided  for  each  recruiter.  Measures  of  each  of  the 
opportunity  bias  factors  were  accumulated  for  the  market  area  of  each  of  the  500 
recruiters. 

Stepwise  multiple  regression  was  used  to  predict  the  theoretical  yield 
of  a  recruiter's  territory  using  12  of  the  15  territorial  factors  in  the  equation 
(three  census  variables  were  excluded).  The  three  best  predictors  were  "Average 
production  per  recruiter  in  subject's  DRC,"  accounting  for  48  percent  of  the 
variance  in  production  scores;  "Average  market  share  for  station  zone";  and 
"Proportion  of  the  zone  that  is  suburban." 

These  three  predictors  which  accounted  for  51  percent  of  the  variance 
in  production  scores,  were  used  to  predict  production  scores  for  each  recruiter. 
Benchmark  Achievement  Scores  (BAS)  were  computed  by  dividing  total  production  by 
predicted  production  and  multiplying  by  100.  The  BAS  were  thought  of  as  unbiased 
production  scores,  corrected  for  the  effects  of  three  important  territorial 
factors. 

The  authors  suggested  that  another  production  measure,  the  Simple 
Achievement  Score  (SAS),  might  be  just  as  useful  as  the  BAS.  Since  "Average 
Production  Per  Recruiter  in  Subject's  DRC"  explained  the  most  variance  in  the 
regression  equation,  a  score  based  on  the  individual's  performance  compared  to 
that  average  would  be  easier  to  compute.  (SAS  correlated  highly  with  BAS  (r 
.96).  so  the   two  scores  were  practically  equivalent.) 

The  second  objective  of  this  study  was  to  develop  a  recruiter  selection 
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battery.  The  battery  was  developed  based  on  the  pilot  study  by  Graham  et  al, 
[Ref.  8]  involving  interviews  with  79  Army  recruiters  with  high,  medium,  and  iov 
records  of  success.  Personnel  from  Array  Recruiting  Headquarters  were  als< 
consulted  about  traits  necessary  for  recruiter  success. 

The  selection  battery  consisted  of  12  paper-and-pencil  inventories  anc 
one  verbal  performance  test.  Below  is  a  list  of  the  measures  included  in  th« 
battery. 

a.  Verbal  Fluency.  Recruiters  were  asked  to  make  a  sales  pitch  to  i 
prospective  enlistee  about  the  benefits  of  Army  life.  Presen- 
tations were  scored  by  computing  the  ratio  of  the  number  of  word* 
spoken  in  two  minutes  to  the  number  of  "ahs"  spoken.  The  author: 
hypothesized  that  an  effective  recruiter  must  be  able  to  tall 
easily  in  a  variety  of  social  situations,  and  they  wanted  t< 
measure  verbal  fluency  orally,  in  the  most  realistic  situatioi 
possible. 

b.  Sociability Measures .     Four   inventories  were  used  to  measure  < 

recruiter's  sociability  and  affiliative  tendency.  The  author: 
hypothesized  that  sociability  was  important  since  a  recruiter  musl 
spend  so  much  time  interacting  with  people  (who  often  an 
strangers) . 

c.  Achievement  Motivation.  Three  inventories  were  used  to  measure 
the  tendency  to  work  hard  to  achieve  self-appointed  goals.  This 
was  hypothesized  to  be  a  positive  characteristic  of  a  gooc 
recruiter. 

d.  Empathy  Measures.  Four  instruments  were  used  to  measure  the 
ability  to  understand  the  point  of  view  of  others  and  the  drive  t< 
win  or  complete  a  sale.  The  authors  believed  empathy  alone  is  nol 
enough.   The  successful  recruiter  goes  on  to  close  the  sale. 

e.  Rejection  Tolerance  Measure.  One  inventory  was  used  to  measure 
tolerance  to  rejection,  rebuffs,  and  insults.  The  hypothesis  was 
that  the  successful  recruiter  has  a  higher  tolerance  for  reject i or 
than  does  the  less  successful  recruiter. 

f.  Responsibility  and  Maturity  Measures.  Three  instruments  col- 
lected information  about  a  recruiter's  ability  to  manage  his 
personal,  financial,  and  official  duties.  Since  recruiters  spenc 
the  bulk  of  their  duty  time  working  without  supervision.  ant 
since  they  represent  their  branch  of  service  to  the  general 
public,  they  are  expected  to  manage  their  personal,  financial,  ant 
official  duties  with  discretion. 
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When  the  time  came  to  administer  the  battery,  the  criterion  development 
project  mentioned  earlier  (BAS  and  SAS)  was  not  yet  completed.  Instead,  the 
authors  created  a  Composite  Supervisory  Rating  procedure  to  select  highly 
successful  and  very  unsuccessful  recruiters.  Recruiters  were  nominated  by 
supervisors.  The  best  were  used  in  the  High  Criterion  Group,  and  the  poorest 
were  used  in  the  Low  Criterion  Group.  The  battery  was  administered,  and  infor- 
mation on  each  recruiter's  race,  religion,  and  aptitude  scores  was  obtained  from 
Array  personnel  files. 

None  of  the  personality  measures  or  aptitude  scores  differentiated 
significantly  between  the  two  groups.  The  verbal  performance  test  and  22  other 
items  differentiated  significantly.  These  items  pertained  to  work  habits,  style 
of  handling  finances  and  debts,  educational  background,  and  reactions  to 
challenging  or  stressful  situations. 

The  authors  suggested  that  because  recruiters  are  a  relatively  homo- 
geneous group  required  to  meet  several  minimum  qualifications  (age,  rank,  GCT 
scores)  and  because  of  their  length  of  time  in  service  (mean  was  14  years)  the 
recruiters  may  have  had  similar  attitudes  and  opinions,  which  would  have  limited 
the  variance  in  attitude,  personal  preference,  and  personality  inventory  scores. 
(The  new  items  that  did  discriminate  were  mostly  from  the  Background  Information 
Form  and  Personnel  Questionnaire,  instruments  dealing  mainly  with  matters  of  fact 
rather  than  attitude.) 

If  the  authors  had  been  able  to  use  the  Simple  Achievement  Score  (SAS) 
they  had  suggested,  rather  than  supervisor  nominations,  perhaps  higher  validities 
might  have  resulted. 
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D.    Assessment  Centers 

1.  Borman,  Toquam,  and  Rosse 

The  1982  Array  study  conducted  by  Borman,  Toquam,  and  Rosse  indicatec 
that  assessment  centers  could  successfully  predict  recruiter  school  performance 
even  with  a  sample  of  recruiters  that  had  been  pre-screened  by  a  selection  panel, 
Assessment  centers  are  believed  to  be  particularly  valuable  for  selection  oJ 
individuals  for  sales  positions.  Assessment  centers  usually  involve  a  candidate 
undertaking  parts  of  an  actual  job  under  observation  and  are  adaptable  foi 
training  for  these  jobs.  Under  this  approach,  trained  observers  rate  potential 
recruiters'  performance  in  several  different  situational  exercises  that  simulate 
aspects  of  the  recruiter  job.  Assessors  were  interested  in  personal  character- 
istics such  as  persuasiveness,  sociability,  flexibility,  and  practical  judgment. 

A  potential  problem  with  the  assessment  center  concept  is  the  assum 
ption  that  people  being  rated  want  the  job.  As  requirements  for  recruiters  have 
grown,  the  Army  has  assigned  most  of  its  recruiters  involuntarily.  The  cost  ane 
the  potential  gaming  by  the  candidate  reduces  the  feasibility  of  using  assessment 
center  ratings  to  select  recruiters.  In  the  1980's,  the  Army's  problem  hae 
become  one  of  motivation  and  development  rather  than  selection.  So,  the  purpose 
of  the  assessment  center  shifted. 

Assessment  exercises  were  reduced  dramatically.  Instead  of  being  usee 
for  selection,  ratings  given  in  a  revised  recruiter  Development  Center  were 
designed  to  give  recruiter  trainees  a  realistic  job  preview  and  positive  feedback 
to  enhance  their  motivation. 

2.  Weltin,  Frieman,  Elig,  and  Johnson 

Weltin,  Friedman,  Elig  and  Johnson,  in  a  1985  study  related  the  ratings 
of  the  origincil  assessment  center  and  a  subsequent   development  center   sample  tc 
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the  number  of  contracts  the  new  recruiter  produced  in  the  first  year  on  the  job 
|Ref.  22J.  The  criterion  measure  attempted  to  account  for  geographic  differences 
in  sales  potential  among  recruiting  battalions.  Previous  work  by  Brown  et  al. 
[Ref.  5]  showed  that  production  per  recruiter  in  the  subject's  battalion 
(district)  accounted  for  48  percent  of  the  variance  in  production  scores.  Some 
Army  recruiting  battalions  have  better  sales  markets  than  others.  To  control  for 
these  geographic  differences  in  sales  potential,  Weltin  et  al.,  partialed  the 
number  of  contracts  per  recruiter  achieved  in  his  battalion  of  assignment  from 
each  recruiter's  performance  score.  While  Borman's  work  related  assessment 
center  ratings  to  training  performance,  this  study  evaluated  the  usefulness  of 
the  ratings  for  predicting  job  performance  as  a  field  recruiter. 

The  assessment  center  sample  included  41  of  57  soldiers  who  hud  taken 
the  original  battery  of  assessment  center  exercises  in  1981  and  completed  the 
training  course.  Each  individual  had  been  rated  by  trained  assessors  in 
exercises  that  included  cold  calls,  interviews,  a  speech,  and  the  in-basket  (.work 
prioritization).  Other  predictors  included  training  school  grades  (written  test 
scores  and  instructor  ratings  of  telephone  and  interviewing  techniques) ,  and 
scores  on  the  following:  a  test  battery  developed  to  select  Navy  recruiters,  an 
experimental  Army  test  battery,  and  the  Gordon  Personal  Profile  and  inventory. 

The  development  center  sample  included  970  recruiters  who  were  rated  in 
the  center,  completed  training,  and  had  at  least  one  contract  their  first  year  on 
the  job.  Assessors  were  not  trained.  Essentially  the  same  exercises  were  used 
as  in  the  assessment  center.  No  personality  or  interest  batteries  were  used. 
Written  training  grades  were  available,  but  instructor  ratings  on  telephone  and 
interviewing  techniques  were  not. 

Results   indicated    that   the   assessment   center   ratings   had   low 
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correlations  with  job  performance;  however,  in  the  development  center  sample,  the 
cold  call  interview  and  speech  exercises  were  significantly  related  to  jot 
performance.  Training  grades  were  not  predictive  in  either  sample.  The 
personality  and  interest  test  scores  significantly  predicted  job  performance. 
Navy  test  scores  (human  relations,  selling  and  organizing  subscaies),  the  ARI 
test,  as  well  as  two  scales  of  the  Gordon  Personal  Profile  and  Inventory,  showed 
moderate  relationships  with  job  performance. 

Stepwise  regression  performed  on  the  development  center  sample 
indicated  that  productivity  of  the  recruiter's  battalion  was  the  single  most 
important  factor  in  predicting  job  performance.  Ratings  on  the  speech  exercise 
and  AFQT  scores  predicted  approximately  two  percent  additional  variance. 

E.        Personnel  Files 

1.    Bennett  and  Haber 

In  1973,  Bennett  and  Haber  investigated  various  factors  that  influence 
the  productivity  of  Marine  Corps  recruiters  [Ref.  23].  They  used  multiple 
regression  to  analyze  the  relative  importance  of  sixteen  variables  on  gross 
productivity  (average  number  of  recruits  enlisted  per  month).  Variables  were 
divided  into  three  categories.  Selection  variables  included  General 
Comprehension  Test  scores,  age,  race,  level  of  education,  number  of  dependents, 
previous  service  as  a  career  planner  or  drill  instructor,  method  of  assignment  to 
recruiting  duty  (volunteer  or  assigned),  and  opinion  about  whether  recruiting 
duty  was  a  financial  hardship.  Deployment  variables  included  whether  recruiters 
were  assigned  to  their  home  states,  distance  from  home  state,  type  of  area 
assigned  to  (urban,  suburban,  or  rural),  number  of  times  assigned,  hours  per  week 
spent  on  recruiting,  and  percentage  of  time  spent  out  of  the  office  recruiting. 
Evaluation  variables  included  number   of  months   on   current   tour  of  duty  and 
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percentile  rank  in  Marine  Corps  recruiter  class. 

The  authors  noted  that  gross  productivity  was  determined  by  regional 
differences  as  well  as  differences  in  individual  recruiters.  To  account  for 
regional  differences,  they  broke  their  sample  of  recruiters  into  two  groups:  one 
group  of  recruiters  from  recruiting  stations  with  high  enlistment  rates,  and  the 
other  from  stations  with  low  rates  of  enlistment. 

Several  variables  were  statistically  significantly  related  to 
productivity.  Results  from  the  high  enlistment  area  group  indicated  that  urban 
and  suburban  recruiters  enlisted  more  people  per  month  than  rural  recruiters,  and 
recruiters  in  their  home  state  enlisted  more  people  per  month  than  those 
stationed  more  than  500  miles  outside  their  home  state. 

In  the  low  enlistment  areas,  those  who  felt  recruiting  duty  was  a 
financial  hardship  enlisted  more  people  per  month  than  those  who  did  not. 
Recruiters  with  prior  service  as  career  planners  were  more  productive  than  those 
who  had  no  experience  as  career  planners.  The  regression  equations  were  not 
cross-validated. 

2.    Best  and  Wylie 

Best  and  Wylie' s  Naval  Postgraduate  School  study  hypothesized  that 
recruiter  characteristics  could  be  combined  to  predict  recruiter  performance 
[Ref.  24].  To  test  their  hypothesis  for  Navy  recruiters,  they  used  a  command 
evaluation  of  each  recruiter  in  their  sample  as  their  dependent  variable. 
Special  consideration  was  given  to  selecting  independent  variables  that  could  be 
obtained  easily  for  each  prospective  recruiter  prior  to  a  recruiting  assignment. 

The  authors  generated  a  cross-tabulation  of  the  independent  variables 
they  had  selected  initially,  and  they  retained  for  analysis  those  variables  with 
the  strongest  relationship  to  the  dependent  variable.   Those  variables  were:   the 
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area  where  the  recruiter  had  spent  his  youth  (urban,  suburban  or  rural);  age; 
General  Comprehension  Test  (GCT)  score  (part  of  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB));  years  of  active  military  service;  and  proximity  of 
childhood  home  to  a  major  body  of  water,  grouped  into  three  distance  categories 
(less  than  20  miles,  20-200  miles,  and  more  than  200  miles). 

The  regression  equation  accounted  for  34  percent  of  the  variation  in 
the  dependent  variable.  Although  the  equation  failed  on  cross  validation,  the 
authors  believed  research  using  this  approach  should  continue.  The  only 
predictor  in  "vie  by  the  Navy  at  this  time  was  the  16PF-m.  As  discussed  earlier, 
this  test  battery  was  a  poor  predictor  of  recruiter  success  and  the  Navy  stopped 
using  it  for  recruiter  selection  in  1976  [Ref.  13;  p.  24]. 
3 .   Shupack 

Shupack  attempted  to  develop  a  profile  of  a  successful  recruiter 
comprised  of  a  combination  of  objective  personal  characteristics  easily 
obtainable  from  existing  personnel  records  [Ref.  13].  She  regressed  six 
independent  variables  against  a  dependent  variable  designed  to  identify  success, 
mediocrity,  or  failure  in  the  recruiting  assignment.  The  independent  variables 
were  paygrade,  education,  years  of  service,  Navy  enlisted  entrance  test  scores, 
previous  rate  (occupation),  and  scores  on  the  16PF-m.  Her  measure  of 
effectiveness  was  defined  in  terms  of  Navy  Recruiting  Command's  Honor  Roll  (five 
enlistments  per  month).  Successful  performance  was  defined  as  completion  of  the 
twenty-month  test  period  and  some  level  of  Honor  Role  performance;  mediocre 
performance  was  defined  as  remaining  in  the  field  for  the  test  period  and  failure 
was  being  transferred  early. 

Using  multiple  regression  on  the  whole  sample  and  on  various  subgroups, 
the  explanatory  factors  explained  a  low  fourteen  and  twenty-one  percent  of  the 
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variance   in   the  case  of  successful  and  unsuccessful  recruiters,  respectively. 
Education,  paygrade,  and  entrance  test  scores   explained  the  most  variance  among 
successful   recruiters.     For   unsuccessful  recruiters,  the  best  predictors  were 
rate,  years  of  service,  and  entrance  test  scores. 
4.    Elig,  Gade,  and  Johnson 

In  a  1983  working  paper,  Elig,  Jade  and  Johnson  described  a  "new 
approach  to  recruiter  selection  research"  [Ref .  4] .  They  suggested  that  previous 
selection  approaches  (biographical  information,  personality  assessment,  and 
interest  inventories)  were  vulnerable  to  compromise  and  probably  would  not  be 
useful  when  recruiters  were  selected  involuntarily.  They  also  commented  on  the 
"criterion  problem,"  acknowledging  that  most  researchers  had  not  found  an 
adequate  performance  measure.   This  study  had  two  objectives: 

a.  To  find  predictors  that  were  readily  available,  stable,  and  secure 
measures  of  recruiter  characteristics,  and 

b.  To  establish  criteria  that  were  readily  available,  objective 
performance  measures  which  differentiated  among  recruit  charac- 
teristics, secure  and  were  relatively  free  from  "opportunity  bias." 

The  Enlisted  Master  File  (EMF)  was  used  as  the  data  source  for 
recruiter  demographic  characteristics  and  the  Military  Enlistment  Processing 
Station  Reporting  System  (MRS)  to  acquire  information  on  recruit  characteristics. 
Both  types  of  data  are  maintained  routinely  by  the  Army. 

The  authors  hypothesized  that  the  EMF  data  would  provide  measures  of 
recruiter  characteristics  that  would  be  useful  in  predicting  productivity  as 
measured  by  recruit  characteristics  taken  from  the  MRS.  They  related  recruiter 
characteristics  to  recruit  characteristics,  and  their  criterion  was  adjusted  for 
opportunity  bias.  Brown  et  al.  [Ref.  5]  earlier  study  accounted  for  48  percent 
of  an  individual  recruiter's  total  production  by  using  average  total  production 
of  all  recruiters  in  the  individual's   District   Recruiting  Command   (DRC)   as  a 
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predictor.  Elig  et  al.,  adjusted  their  criterion  by  subtracting  DRC  averaj 
production  from  the  raw  contract  totals  of  each  recruiter  in  the  DRC. 

The  sample  consisted  of  552  male  and  60  female  recruiters  on  products 
during  FY79.  Characteristics  that  correlated  with  contract  production  wei 
identified  using  analysis  of  covariance  techniques. 

In  this  study,  the  measures  of  opportunity  bias  (DRC  Averaj 
Production)  explained  32  percent  of  the  variance  in  productivity,  compared  to  I 
percent  found  by  Brown  et  al.  The  remaining  variance  was  believed  to  ha^ 
resulted  from  unmeasured  opportunity  bias,  individual  recruiter  differences,  ai 
measurement  error.  All  effects  listed  below  were  significant  to  at  least  the  .( 
level. 

a .  Recruiter  Education. 

Recruiters  with  postsecondary  education  recruited  better  educated,  bi 
lower  AFQT,  male  recruits. 

b.  AFQT. 

Recruiter  AFQT  correlated  positively  with  recruit  AFQT  in  its  "prims 
market,  high  school  diploma  graduate  and  senior  males  (HSDG/SR)  and  hi 
little  impact  on  females  or  non-high  school  graduates  (NHSG). 

c.  Gender. 

Recruiter  gender  had  no  effect  on  total  numbers  or  quality  of  recruiU 

d.  Age. 

Older  recruiters  contracted  more  male  and  fewer  female  recruits  tht 
younger  recruiters.  They  did  this  by  underproducing"  high  AFQT  ai 
overproducing  low  AFQT  recruits  in  the  HSDG/SR  market.  In  tolt 
production  younger  males  outproduced  older  males,  while  older  female 
outproduced  younger  females.  Younger  male  recruiters  outperforms 
their  female  counterparts,  while  older  females  outperformed  all  others 

e.  Rank. 

Higher  ranking  recruiters  achieved  success  in  the  HSDG/SR  market  t 
contracting  more  low  AFQT  (category  IV)  recruits  than  lower  rankin 
recruiters. 

f .  Ethnic  Group . 

Like  recruited  like.  Black  recruiters  enlisted  Lhe  most  Blacks 
Hispanic  recruiters  enlisted  the  most  Hispanics.  Whites  the  mos 
whites,  etc. 


36 


The  results  indicated  that  recruiter  demographic  characteristics  may  be  related 
to  recruit  characteristics  when  opportunity  bias  is  removed,  and  that  demographic 
data  may  be  useful  for  selecting  recruiters  from  a  non-volunteer  pool.  However- 
several  questions  remained: 

1.  Would  these  findings  be  replicated  with  other  samples  and  in  other 
recruiting  environments   (e.g.,   where  unemployment  is  higher)? 

2.  Why  do  tradeoffs  exist  between  AFQT  and  education?  Recruiters  who 
penetrated  the  HSDG/SR  market  will  so  at  the  expense  of  AFQT. 

3.  Are  these  relationships  likely  to  continue?  The  data  in  this  paper 
were  simple  correlations  and  were  not  tied  to  a  well  reasoned  theory. 
At  the  end  of  their  paper,  the  authors  mentioned  that  they  would 
attempt  to  crossvalidate  this  paper's  results  and  develop  a  theoretical 
rationale  for  them. 

Differences  in  recruiting  performance  by  race  may  indicate  an 
intentional  opportunity  bias  because  of  deliberate  (but  unofficial)  stationing  of 
minorities  in  areas  with  large  minority  populations. 

Age  related  differences  in  performance  may  also  reflect  an  inherent 
opportunity  bias  in  the  case  of  older  (and  higher  ranking)  recruiters  who  often 
have  duty  assignments  (i.e.,  station  commander)  involving  responsibilities  in 
addition  to  recruiting. 

F.    Overview 

This  review  has  identified  extensive  literature  on  the  recruiter 
selection  problem.  Although  a  considerable  amount  of  relevant  work  has  been 
undertaken,  the  results  generally  were  disappointing.  Two  distinct  types  of 
factors  have  been  examined  for  their  utility  in  predicting  whether  or  not  an 
individual  would  be  a  successful  recruiter.  One  class  of  factors  includes  those 
for  which  information  can  be  found  in  standard  military  personnel  files.  Many 
studies  used  traditional  analytical  methods  such  as  regression  analysis  to 
determine  whether    recruiter   productivity   could  be   predicted  by   various 
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combinations  of  factors.  If  these  factors  could  be  identified,  they  could  b 
used  to  select  for  recruiting  duty  those  individuals  with  the  highest  probabilil 
of  success.  The  most  frequently  used  personnel  file  type  variables  were  age 
gender,  rank,  education,  entrance  test  scores,  etc. 

The  other  class  of  factors  are  various  personality  characteristics 
Past  studies  show  that  many  researchers  understood,  at  least  intuitively,  tha 
successful  recruiters  possess  some  common  personality  characteristics.  A  wid 
variety  of  specific  tests  have  been  developed  to  measure  personal i I 
characteristics  and  have  been  used  with  varying  amounts  of  success.  Table 
summarizes  the  individual  characteristics  that  prior  studies  have  indicated  a 
significantly  related  to  being  a  successful  recruiter. 


Table  6.   Summary  of  characteristics  related  to  recruiter  success; 


Age  (older  if  female,  younger  if  male) 

Marital  status 

Education 

Paygrade 

Length  of  service 

AFQT  scores 

Racial  match 

Plans  ahead 

Uses  systematic  approach  in  prospecting 

Knowledgeable  about  recruiting 

Sales  experience 

Verbal  fluency 

Persuas  i veness 

Communicates  effectively 


Self-motivated 

Ambitious 

Desire  to  excel 

Aggressive 

Dominant 

Confident 

Enthusiastic,  positive 

Mature 

Financially  stable 

Extroverted 

Enjoys  working  with  others 

Spontaneous 

Influences  others 

Well  groomed 


Most  of  the  past  research  on  recruiter  selection  suffered  from  one  or  more  of  thj 
same  serious  flaws:  poor  criterion  measurement,  lack  of  knowledge  of  thl 
recruiter  job,  and  failure  of  results  to  remain  significant  upon  cross- 
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validation.    As  a   result,  findings  of  many  of  these  studies  are  of  questionable 
value. 

The  criterion  problem,  or  measuring"  recruiter  performance  in  a  reliable 
and  valid  manner,  was  probably  the  single  most  important  reason  why  past  research 
explained  relatively  little  variance  in  recruiter  productivity.  Researchers  use 
various  measures  of  performance  as  their  dependent  variable,  such  as  supervisory 
ratings,  school  performance,  percent  of  quota  achieved,  and  total  number-  of 
enlistments,  only  to  find  that  each  measure  suffered  from  Lts  own  set  of 
weaknesses.  For  example,  although  recruiter  production  figures  were  easy  to 
obtain  and  use,  the  measure  was  contaminated  by  market  factors  not  related  to 
individual  recruiter  productivity.  Researchers  have  worked  on  this  problem  with 
some  success,  but  more  work  on  incorporating  market  factors  into  recruiter- 
success  models  is  needed. 

Recent  work  has  integrated  lessons  learned  from  earlier  studies. 
Production  measures  have  become  more  sophisticated,  attempting  to  account  for  the 
powerful  influence  of  "opportunity  bias,"  or  the  effects  of  geographic,  socio- 
economic and  organizational  variables  on  individual  recruiter  productivity. 
Comprehensive  job  analysis  has  provided  a  greater  understanding  of  what  the 
recruiter's  job  really  is.  Yet,  despite  the  increased  sophistication  of  recent 
work,  a  reliable  profile  of  the  successful  recruiter  is  still  not  generally 
agreed  upon.  Statistically  significant  findings  are  scarce,  and  very  few  results 
remain  significant  after  cross-validation. 

Further  research  needs  to  be  undertaken  in  the  area  of  determining  an 
efficient  and  effective  set  of  decision  criteria  for  selecting  individuals  with  a 
high  likelihood  of  becoming  successful  recruiters.  The  set  of  factors  identified 
in  table  6  are  too  numerous  to  be  efficient  for  selection  criteria.   They  must  be 
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reduced  to  a  more  manageable  total.  These  sets  of  individual  attributes  shoJ 
then  be  evaluated  to  determine  how  important  each  one  is  in  selecting  potential! 
successful  recruiters.  Expert  systems  is  one  method  that  offers  promise  < 
substantial  gains  in  obtaining  an  efficient  and  effective  set  of  selecti< 
criteria  for  identifying  potentially  successful  recruiters. 


40 


III.   METHODOLOGY 

A.    Multiattribute  Utility  Theory 

Traditional  methods  for  identifying  the  personal  characteristics  which  are 
associated  with  recruiter  success  rely  on  the  existence  of  reliable  and  valid 
measures  of  both  the  relevant  personal  attributes  and  of  recruiter  performance. 
The  literature  and  data  review  in  Chapter  II  indicate  that  such  information  is 
not  available  from  personnel  data  files  and,  in  particular,  that  the  "criterion 
problem",  or  lack  of  a  measure  to  use  in  explaining  variance  in  recruiter 
productivity  based  solely  on  individual  differences,  prohibits  the  successful 
application  of  multivariate  statistical  techniques. 

The  process  used  by  USAREC  to  select  its  USAR  recruiters  is  subjective  and 
is  based  on  the  experience,  knowledge,  judgment  and  intuition  of  the  selecting 
officials.  (This  process  is  described  in  Chapter  I.)  Selection  board  members 
review  applications,  conduct  interviews  and  then  make  individual  evaluations  and, 
finally,  come  to  a  collective  decision  as  to  the  probability  that  an  applicant 
would  be  a  successful  recruiter.  One  approach  to  the  development  of  a  model  for 
recruiter  selection  would  be  to  incorporate  the  elements  of  this  subjective 
process  into  the  model-building  procedure. 

Some  experts  in  the  process  of  social  decision  making  believe  that  decisions 
do,  and  should,  depend  on  subjective  quantities  such  as  values  and  probabilities. 
Disagreements  over  policy  decisions  generally  hinge  on  disagreements  about 
values.  Often,  although  those  in  conflict  may  agree  about  the  relative 
dimensions  of  value,  they  disagree  about  the  relative  importance  of  various 
goals.  Some  aspects  of  value  are  matters  of  objective  information,  expertise,  or 
both.   [Ref.  25;  p.  326]. 

Edwards  has  suggested  that  organizational  decisions  should  depend  on  some 
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kind  of  social  consensus  or  aggregation  of  individual  views,  rather  than  on  an 
single  individual's  views.  He  proposed  the  use  of  multiat tribute  utilit 
measurement  as  a  solution  to  the  problems  encountered  in  this  arena.  This  me the 
can  spell  out  explicitly  the  values  of  each  group  participant,  show  how  and  ho 
much  they  differ  and,  in  the  process,  reduce  the  extent  of  such  differences  [  Ref 
25;  p.  221}. 

Edwards'  measurement  technique  could  be  applied  to  USAREC's  recruite 
selection  procedure.  Its  group  process  is  affected  by  differing  values  anion 
group  members  and  by  taking  into  account  objective  information  regardin 
recruiter  selection  as  well  as  relevant  expertise  among  group  members  or  othe 
experts.   USAHEC  could  define  a  set  of  values  for  recruiter  selection. 

This  technique  is  based  on  extensive  use  of  simple  rating  procedures.  Ever 
decision  may  have  value  on  a  number  of  different  dimensions.  Mult Lattribut 
utility  measurement  attempts  to  discover  those  values,  one  dimension  at  a  time 
and  aggregate  them  across  dimensions  using  a  suitable  aggregation  rule  an 
weighting  procedure.  The  procedure  for  obtaining  group  consensus  has  ten  steps 
They  are  listed  briefly  below: 

1.  Identify  the  person(s)  or  organization(s)  whose  utilities  are  to  b 
maximized. 

2.  Identify  the  issue(s)  (decisions)  to  which  the  utilities  needed  ar 
relevant. 

3.  Identify  the  entities  to  be  evaluated.  (For  the  Army  Recruit  in 
Command,  these  might  be  recruiter  applicants.) 

4.  Identify  the  relevant  dimensions  of  value  for  evaluation  of  th 
entities.  (Specify  a  simple  list  of  goals  that  seem  important  for  thj 
purpose  at  hand. ) 

5.  Rank  the  dimensions  in  order  of  importance.  (This  can  be  doni 
individually  or  in  groups. ) 

6.  Rate  dimensions  in  importance,  preserving  ratios.  i How  much  morj 
important  is  one  dimension  than  another?) 
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7.  Sum  the  importance  weights,  and  divide  each  by  the  sum.  This 
computation  converts  importance  weights  into  measures  which  arc  similar 
to  probabilities. 

8.  Measure  the  location  of  each  entity  being  evaluated  on  each  dimension. 

9.  Calculate  utilities  for  entities  as  follows: 

Ui  =  WjUij,  and  wj  =  I.  'Eqn  L) 

Ui  is  the  aggregate  utility  for  the  ith  entity  while  w,  is  the 
normalized  importance  weight  of  the  jth  dimension  of  value,  and  Ui  j  is 
the  rescaled  position  of  the  ith  entity  on  the  jth  dimension.  Thus  w, 
is  the  output  of  step  7,  and  Ui j  is  the  output  of  step  8.  This 
equation  is  the  formula  for  a  weighted  average. 

10.    Decide  by  maximizing  Ui  .   If  a  subset  of  i   is  to  be  chosen,   then  the 
subset  for  which  Ui  is  maximum  is  best.   [Ref.  25;  pp.  328-329]. 

B.    Expert  Systems 

The  application  of  the  principles  of  multiattribute  utility  theory  to  j 
complex  decision-making  environment  such  as  recruiter  selection  requires  the  use 
of  sophisticated  tools  for  extracting  knowledge  about  recruiter  success  factors 
from  those  who  have  wide  experience  in  this  area.  Some  method  must  also  be  found 
for  weighting  the  various  factors  identified  by  individual  experts  in  recruiter 
selection  and,  finally,  a  synthesis  of  expert  opinion  should  be  obtained. 

Expert  systems  technology  provides  an  approach  to  decision  making  support 
which  can  incorporate  multiattribute  utility  concepts.  While  there  is  wide 
diversity  in  the  structure  and  computer  requirements  of  expert  or  knowledge-based 
systems,  recent  developments  have  made  some  systems  available  for  use  with 
microcomputers  and  this  represents  an  important  potential  source  of  assistance  in 
the  development  of  models  for  personnel  selection   [Ref.  26J . 

Artificial  intelligence  is  the  umbrella  term  used  to  describe  a  set  of 
technologies  designed  to  make  computers  imitate  aspects  of  human  thought.  Expert 
systems  (along  with  robotics  and  natural  language  processing)  is  one  specific- 
direction  that  this  general  area  of  research  has  taken  [Ref.  27] . 

Expert  systems  are  computer  programs  which   use   the   knowledge   of  experts 
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about  a  specific  problem  to  simulate  the  application  of  human  expertise  to  soivf 
the  problem.  Specific  information  (such  as  the  characteristics  of  recruiter 
applicants)  is  combined  with  procedures  for  drawing  inferences  and  reachinj 
conclusions  about  that  information  (i.e.,  the  selection  decision).  Thest 
programs  are  quite  different  from  other  computer  programs  in  that  they  use  rules 
(hueristics)  to  reach  an  acceptable  solution  to  a  problem  rather  than  usinj 
mathematical  analysis  (algorithms)  to  find  an  optimal  or  correct  solution.  The 
expert  system  program  itself  contains  a  set  of  instructions  which  enable  it  tc 
create  these  rules  or  procedures  by  querying  experts  in  the  problem  area.  The 
subjective  aspects  of  decision  making  which  characterize  solutions  to  cornple> 
problems  like  personnel  selection  can  thus  be  incorporated  into  the  program. 
The  steps  in  the  development  of  an  expert  system  are  as  follows: 

1.  A  ' toolbuilder'  or  designer  constructs  a  general  program  or  shell  whicl 
can  be  used  to  collect  knowledge  and  determine  rules  for  solving  manj 
specific  problems.  The  expert  system  building  tool  is  a  programming 
language  especially  suited  to  the  construction  of  knowledge-basec 
systems.  LISP  and  PROLOG  are  the  two  languages  used  for  this  purpose. 
There  are  many  versions  of  both  languages  available.  The  programming 
skills  necessary  for  constructing  an  expert  system  shell  "from  scratch" 
are  not  widely  distributed.  The  builders  of  particular  expert  systems 
frequently  acquire  these  shells  from  others  rather  than  building  then 
[Hef.  28 j. 

2.  A  "knowledge  engineer"  is  someone  skilled  and  experienced  in  the  pro- 
cess of  obtaining  the  knowledge  of  experts  in  a  field.  He/she 
interviews  "domain  or  area  experts"  who  are  those  known  for  producing 
good  solu-  tions  to  the  particular  type  of  problem  under  study.  This 
is  called   the  "knowledge  acquisition"  phase. 

The  knowledge  engineer  then  organizes  the  knowledge  he  or  she  has 
obtained  and  decides  how  to  represent  It  in  the  expert  system.  Three 
techniques  used  most  frequently  in  building  expert  systems  are  rules, 
semantic  nets,  and  frames.  The  rule-based  method  uses  IF  (condition) 
and  THEN  (action)  statements  and  is  the  most  commonly  utilized.  The 
other  two  methods  use  a  network  of  nodes  connected  by  relations  and 
organized  into  a  hierarchy.  Each  technique  suits  the  representation  of 
particu-  lar  kinds  of  knowledge  -  causal  linkages,  deductive  processes, 
relat-  ional  knowledge,  classification,  etc.   [Ref .  29 j . 

The  reasoning  mechanism  ("inference  engine")  used  by  the  program  which 
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controls  the  evaluation  of  a  problem  and  evaluates  the  rules  in  the 
knowledge  base  is  selected  by  the  knowledge  engineer  and  is  usually 
either  forward  chaining  or  backward  chaining.  Forward  chaining  at- 
tempts to  reach  a  goal  given  some  initial  state  (it  is  "data  driven"), 
while  backward  chaining  works  from  a  hypothesis  to  seek  the  evidence 
(data)  that  will  support  it. 

Sometimes  the  users  of  expert,  systems  programs  acquire  this  part  of  the 
expert  system  (or  some  aspects  of  this  element)  from  knowledge  engi- 
neers who  have  built  systems  to  solve  problems  similar  to  the  one  the 
user  is  addressing.  The  kinds  of  expertise  needed  for  knowledge  engi- 
neering are  relatively  rare.  It  is  often  cost-effective  to  purchase  an 
"off  the  shelf"  expert  system  program  which  has  been  designed  so  that 
the  end-user  can  build  a  system  for  a  particular  application  with  only 
very  limited  understanding  or  knowledge  of  engineering  techniques 
[Ref.  28]. 

3.  Finally,  the  user  of  the  expert  system  applies  the  computer-  software  by 
giving  the  program  specific  data  and  asking  for  a  choice  or  decision  to 
be  made.  Expert  systems  have  been  used  successfully  to  solve  a  variety 
of  problems  such  as  medical  diagnosis,  budget  analysis,  automatic 
speech  recognition,  and  mechanical  design  specification.  Problems 
which  do  not  have  a  unique  answer,  which  are  not  successfully  solved 
using  algorithms,  and  for  which  there  are  experts  available  are  candi- 
dates for  expert  systems  approaches.  Personnel  selection  falls  into 
this  category  of  potential  application  areas  but  very  limited  work  has 
been  done  as  yet  in  this  field  [Ref.  26 j . 

C.    An  Expert  System  for  Recruiter  Selection 

The  peculiar  characteristics  of  the  recruiter  selection  problem  dictated  the 
choice  of  an  expert  system  that  would  support  a  decision  when  no  criterion 
variable  was  available  for  the  development  of  an  empirical  model.  Mainframe 
artificial  intelligence  programs  often  can  deal  with  a  breadth  of  problems  which 
are  not  encountered  in  the  recruiter  selection  environment  and  would  have  made 
the  application  unnecessarily  complex.  The  expert  system  selected  for  use  in 
examining  the  USAJR  recruiter  question,  EXPERT87,  provides  the  required  ability  to 
operate  in  the  absence  of  a  well  defined  dependent  variable.  It  does  not  embody 
needlessly  complex  simulations  of  human  reasoning  and,  in  addition,  it  presents 
the  interaction  of  experts  with  a  knowledge  base  and  the  results  in  a  way  that  is 
easily  understood  by  experts  and  other  users.   This  program  can  be  operated  with 
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a  personal  computer  and  thus  can  be  used  at  many  more  locations  than  would  be  i 
case  with  a  mainframe  expert  system. 

The  developer  of  EXPERTS?  has  classified  his  system  as  one  of  a  type  1 
calls  Quasiartificial  Intelligence  (QAI),  [Ref.  30],  a  less  ambitious  variant  c 
artificial  intelligence  (AI).  QAI  systems  avoid  many  of  the  pitfalls  < 
traditional  AI  approaches  because  they  do  not  attempt  to  simulate  so  many  aspeel 
of  human  reasoning  processes. 

These  systems  build  on  a  well-defined  format  for  the  problem  space.  Matt 
ematically,  a  QAI  problem  space  is  hierarchical  and  geometric,  as  opposed  t 
Linguistic  or  symbolic,  as  in  AI.  QAI  systems  present  the  attributes  of  uecisii 
alternatives  by  means  of:  (1)  well-structured  profiles  of  hypothetical  cas 
data,  rather  than  by  descriptive  phrases;  (2)  queries  requiring  either  binary  t 
probabalistic  judgments  on  the  part  of  the  experts;  or  (3)  by  means  of  hypothetl 
cals  which  require  the  expert  to  rely  on  plausible  rules.   [Ref.  28,  p.3J. 

The  program  selected  provides  a  format  for  gathering  intuitive  knowledg 
quickly  from  experts  and  in  a  manner  that  permits  verifiable  estimation  of  tl 
trustworthiness  of  the  expert  systems  that  emerge.  The  method  generates  hier 
archical  profiles  of  hypo the tical  alternatives  (in  this  case,  recruiters).  The 
software  generates  attribute  values  for  each  profile  or  alternative  which  opti 
mizes  the  probability  that  the  expert's  resulting  model  correctly  represents  tl 
expert's  intuitive  knowledge.  [Ref.  30;  p.  4]. 
D.    The  Successful  Recruiter  Model 

Figure  2  depicts  the  hierarchy  developed  to  model  the  profile  of  a  success 
fui  recruiter.  The  goal  of  the  model  is  to  identify  and  weight  the  character 
istics  of  the  successful  recruiter  and  this  goal  appears  as  the  node  at  the  to 
of  the  hierarchy. 
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Based  on  the  Literature  review  and  on  discussions  with  experts  in  the  re 
cruiting'  field,  characteristics  believed  to  be  related  to  recruiter  success  wer 
identified  (see  Table  6,  Chapter  II)  and  organized  into  logical  categories 
These  groupings  included: 

1.  Communication  skills, 

2.  Demographic  characteristics, 

3.  Military  background, 

4.  Personality  characteristics, 

5.  Behavior  characteristics, 

6.  Specific  experience. 

These  "dimensions"  become  the  largest  branch  nodes  of  the  hierarchy.  The  charac 
teristics  or  "attributes"  within  each  dimension  appear  below  these  nodes  in  Fig 
ure  2,  and  are  specified  as  follows: 

1.  Communication  Skills 

Public  Speaking  Skills-The  recruiter's  ability  to  stand  before  a  g'roJ 
of  people  and  convey  information  so  as  to  motivate  an  audience  i 
thought  to  be  an  attribute  a  successful  recruiter  possesses. 

Writing  Skills-Although  a  recruiter's  job  involves  very  little  writing 
it  is  such  a  large  part  of  communicating  that  it  was  included  in  th 
model. 

Listening  Skills-Many  of  the  recruiters  who  tested  this  model  believ 
that  listening  skills  are  the  most  important  aspect  of  a  recruiter' 
communication.  By  asking  open-ended  questions  and  carefully  listenin 
to  an  applicant,  the  successful  recruiter  can  provide  informatio 
targeted  specifically  at  the  needs  and  desires  identified  by  th 
individual. 

Informing-The  successful  recruiter  has  the  ability  to  recal 
information  necessary  to  inform  the  applicant  effectively  on  al 
aspects  of  military  life. 

Persuadi ng-The  successful  recruiter  must  be  able  to  close  the  sale. 

2.  Demographic  Characteristics 

Age- An  older  recruiter  may  not  be  able  to  relate  to  a  young  applicant 
while  a  very  youthful  recruiter  does  not  have  enough  experience  to  hel] 
an  applicant. 

Family  Support-An  aspect  of  recruiting  that  affects  the  probability 
that  a   recruiter  will   be  successful   is  the   issue  of  family  support 
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particularly  of  the  spouse.  Recruiting  duty  often  means  living  in 
areas  away  from  a  military  community  and  services  the  family  depends 
upon.  Living  away  from  military  commissaries,  exchanges,  and  medical 
facilities  can  create  or  increase  financial  hardship  and  stress  for 
families.  Recruiting  also  involves  long  hours,  weekend  work,  and 
travel  away  from  home. 

Armed  Forces  Qualifying  Test  (AFQT)-The  literature  suggests  that 
intelligence  is  directly  related  to  recruiter  success. 

College  Experience- Education  and  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  scores  are  often  used  as  readily  available  measures  of 
intelligence. 

3.  Military  Background 

Pay-grade-The  recruiters  who  tested  this  model  all  felt  that  the  most 
successful  recruiters  are  E-6's.  E-5's  and  E-7's  are  next,  and  E-8.'  s 
and  E-9's  Last.  E-4's  and  below  do  not  possess  the  necessary 
experience  to  be  successful  and  E-8's  and  E-9's  tend  to  intimidate 
applicants. 

Years  of  Service  (Active) -A  recruiter  must  have  experience  in  t he- 
service  in  order  to  have  credibility. 

Years  of  Service  (Reserve)-For  reserve  recruiters,  some  experience  in  a 
reserve  unit  is  necessary  in  order  to  sell  the  candidate  on  reserve 
life. 

4.  Personality  Characteristics 

Self- Image-The  successful  recruiter  has  a  positive  self-image  and 
outstanding  military  bearing. 

Integri ty-This  attribute  was  often  selected  as  the  most  important 
characteristic  within  this  dimension.  A  recruiter  who  lacks  this 
attribute  is  likely  to  recruit  fraudulent  enlistments  and  to  be  removed 
early  from  recruiting  duty. 

Ext rover ted-The  successful  recruiter  is  interested  in  others  and  is 
outgoing. 

Sense  of  Humor- This  may  help  a  recruiter  enjoy  the  job,  and  may  help 
keep  him/her  on  an  even  keel  in  a  very  demanding  job. 

Peopl e-Or ien ted-The  successful  recruiter  enjoys  working  with  people. 

5.  Behavior  Characteristics 

Self  starter- A  recruiter's  job  entails  working  alone.  The  recruiter- 
must  be  able  to  motivate  himself/herself  to  initiate  the  complete 
tasks. 
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Commitment -To  be  successful,  the  recruiter  must  like  his/her  job  and 
committed  to  it. 

Flexibility- A  successful  recruiter  must  be  able   to  adapt   to  his/h 
environment  and  change  plans  on  a  moment's  notice. 

Attention  to  Detail-To  be  successful,  the  recruiter  should  be  able 
plan  activities  over  various  time  periods.  He/she  must  also 
organized  so  as  not  to  forget  a  single  detail. 

Decisiveness-The  successful   recruiter  must  be  able  to  make  a  decisi 
on  his/her  own. 

6.    Specific  Experience 

Sales  Experience-Civilian  sales   experience  may  be  a  substitute  f 
recruiting  experience,    since   recruiters   are  often   described 
salespeople. 

Public  Speaking  Expcrience-A  person  with  public  speaking  experience  h 
presented  information   to  groups  and  has  an  advantage  over  other 
recruiters. 

Counselling  Experience-A  recruiter  with   prior   counselling  experi.cn 
has  advised  individuals  and  helped  them  to  make  decisions. 

For  each  of  the  six  dimensions  described,  the  model  will  generate 
number  of  hypothetical  profiles  which  each  expert  will  evaluate.  The  softwa 
takes  the  expert  through  evaluations  of  attributes  within  each  dimension  a 
evaluations  of  the  relative  importance  of  dimensions.  A  specially  construct 
set  of  attribute  values  is  constructed  for  each  attribute  which  defines  t 
dimension.  The  larger  the  number  of  attributes  within  the  dimension,  the  mo 
profiles  the  system  will  generate  for  expert  assessment.  This  is  necessary 
provide  sufficient  sample  size. 

Each  profile  is  presented  in  graphic   form  for   the  expert   to  examin 
reflect  on,  and  assess,  as  depicted  in  Figure  3.   For  each  dimension,  experts  u; 
their  own  knowledge,  experience,  and  intuition   to  evaluate   individual  recruit 
candidates  having  profiles  of  attributes  for  that  dimension.   The  assessment 
based  on  the  scale  shown  at  the  bottom  of  the  graph.   The  expert  enters  a  score 
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communication  skills  dimension 
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from  00  to  99  depending  on  his/her  overaii  evaluation  of   that  individual.    Th: 
procedure  is  then  repeated  for  each  dimension  in  the  model. 

Once  the  last  profile  has  been  evaluated,  the  software  completes  i 
mathematical  routines  and  stores  functional  relationships  between  attributes  ai 
dimensions.  Now  that  the  expert  system  is  in  place,  it  can  evaluate  real  altej 
natives  based  on  each  expert's  expertise.  An  additional  profile  is  displayed  ai 
evaluated  based  on  the  expert  system  just  created.  After  the  expert  enters  hii 
her  assessment,  the  system  displays  its  predicted  value  of  that  expert's  assess 
ment.  With  reasonable  care,  the  expert's  response  should  be  accurate  to  with; 
five  or  six  percent  of  the  system's  findings. 

One  of  the  most  important  evaluation  tools  contained  in  the  program  ii 
the  Fidelity  index.  This  index  indicates  how  successful  the  program  was  J 
developing  an  expert  system  that  correctly  models  the  expert's  own  intuitions 
If  Fidelity  is  less  than  80  percent,  there  is  a  strong  indication  that  tl 
expert's  evaluations  were  inconsistent,  which  means  that  the  intuitive  c 
cognitive  processes  underlying  the  expert's  assessments  were  not  used  in 
consistent  way. 

Relative  weights  are  calculated  for  each  expert,  indicating  It 
relative  importance  of  each  attribute  or  dimension.  The  software  determines  ( f c 
each  expert)  the  shape  of  the  function  relating  each  attribute  to  the  diinensic 
or  concept,  whether  it  is  positive  or  negative,  monotonic  or  non-monotonic 
linear,  convex,  or  concave. 

This  information  provides  the  expert  with  a  better  understanding  o 
his/her  intuitive  processes  and  personal  values.  The  sign  of  the  non  tinea 
component  is  actually  the  second  derivative  of  the  concept  under  evaluation  wit 
respect  to  the  attribute.     Positive  signs   indicate   U-shaped   functions,  an 
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negative  signs  indicate  functions  which  rise  to  a  peak,  accelerating  at  a 
decreasing  pace,  and  then  reversing.  If  an  attribute  has  a  relatively  large 
linear  component,  this  implies  that  the  value  of  the  concept  increases  linearly 
with  the  magnitude  of  the  attribute.  If  the  relative  weights  also  contain  a 
significant  negative  non-linear  component,  this  implies  a  leveling  off,  or  a 
reversal  of  this  trend  for  the  larger  magnitudes  of  the  attribute.  [Ref.  28;  pp. 
84-85]. 

At  no  time  does  the  program  ask  the  expert  to  indicate  the  importance 
of  each  attribute.  This  information  is  generated  by  the  program  based  on  the 
expert's  evaluation  of  profiles  of  individual  candidates  with  specific  measured 
quantities  of  each  attribute.  The  Fidelity  index  is  then  used  as  an  indicator  of 
how  accurately  the  model  simulates  the  expert.  [Ref.  28;  p.  851. 
E.    Expert  Selection  and  Model  Application 

For  the  recruiter  selection  problem,  the  experts  selected  were  currently  on 
recruiting  duty  and  widely  regarded  as  successful,  or  recruiter  instructors  who 
had  been  successful  in  the  field.  Six  of  the  experts  were  AGR  recruiters,  four 
of  them  field  recruiters  from  Indiana  battalions  and  two  instructors  at  the 
recruiter  school  at  Fort  Benjamin  Harrison,  Indianapolis.  Ten  additional  Active 
duty  recruiter  instructors  at  the  school  were  also  included. 

This  test  group  is  very  small.  It  was  not  selected  to  be  either  a  random  or 
representative  sample  but  rather,  it  provided  a  conveniently  sized  group  for  use 
in  developing  and  evaluating  a  prototype  model.  Expert  systems  methodology 
usually  proceeds  in  this  way,  by  choosing  "recognized  experts,"  rather-  than  by 
exhaustive  interviewing  of  many  subjects.  Further  work  should  involve  using  the 
format  for  knowledge  acquisition  developed  here  to  elicit  responses  from 
individual  experts   chosen  by   those  who  are  qualified   to  recognize  exceptional 
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ability  in  recruiter  selection. 

The  model  was  used  to  create  an  expert  system  for  each  of  these  16  expel 
recruiters.  Similarities  and  differences  among  the  expert  systems  are  analyz» 
in  Chapter  IV.  In  addition,  a  composite  model  was  constructed  using  the  me; 
scores  of  the  16  experts  and  this  is  compared  with  the  individual  models  as  we. 
as  with  a  "patchwork"  model  which  represents  another  technique  for  combining'  tl 
results  for  a  group  of  experts. 

Trends  and  relative  weights  among  dimensions  and  attributes  were  also  cor 
sidered  to  determine  if  a  consistent,  clearly  identifiable  profile  of  a  success 
ful  recruiter  emerges.  Finally,  an  evaluation  of  hypothetical  recruiter  appli 
cants  was  examined  to  compare  the  ratings  of  the  same  applicants  by  all  the  e> 
pert  systems. 
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IV.   ANALYSIS  AND  RESULTS 

A.   Dimensions 

Table  7  (USAR  recruiters)  and  Table  8  (RA  recruiters)  present  the  relative 
weights  assigned  to  the  model's  six  dimensions  by  each  of  the  sixteen  experts. 
The  weights  in  each  column  sum  to  (approximately)  one  and  may  be  interpreted  as 
the  relative  importance  of  one  dimension  in  relation  to  the  others.  For  example, 
Expert  l's  weight  for  the  Demographic  Characteristics  dimension  is  0.321,  which 
is  approximately  6  times  as  important  as  the  Behavior  Characteristics  dimension 
which  has  a  relative  weight  of  0.05.  A  more  detailed  display  for  each  expert  is 
contained  in  Appendix  A. 

The  weighting  schemes  (Tables  7  and  8)  for  the  two  types  of  recruiters  both 
show  the  greatest  relative  value  given  to  the  communication  skills  dimension 
(.285  for  USAR  and  .434  for  RA) .  The  weights  for  the  other  five  dimensions  do 
not  follow  the  same  pattern  for  Reserve  and  Active  Duty  recruiters. 

Table  9  (USAR  recruiters)  and  Table  10  (RA  recruiters)  display  the  expert 
systems'  most  important,  second  most  important,  and  least  important  dimensions 
along  with  their  relative  weights  for  the  two  recruiter  groups.  Communication 
Skills,  Demographic  Characteristics,  and  Personality  Characteristics  were  the 
most  important  dimensions  for  the  USAR  Recruiters.  Military  Background  and 
Behavior  Characteristics  were  next  in  importance,  and  Specific  Experience  was 
judged  least  important  of  the  six  dimensions.  The  Active  recruiters  judged 
Communication  Skills,  Personality  Characteristics,  and  Behavior  Characteristics 
as  the  most  important  dimensions.  Military  Background,  Specific  Experience,  and 
Demographic  Characteristics  were  all  much  less  important.  Hence,  the  main 
difference  between  RA  and  USAR  recruiters  lay  in  the  Demographic  dimension  which 
was  of  greater  importance  to  the  Reserve  recruiters. 
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Table  7.   Relative  weights  of  dimensions, 
Reserve  recruiters 


Expert 


Dimension 

Communicat 

ion  Demographic 

Military 

Personal] 

Lty 

Behavior 

Specific 

skills 

characteristics 

background 

characteristics 

experienc( 

1 

.305 

.321 

.069 

.190 

.050 

.065 

2 

.299 

.176 

.045 

.128 

.123 

.229 

3 

.245 

.191 

.067 

.188 

.127 

.182 

4 

.267 

.052 

.517 

.023 

.086 

.055 

5 

.140 

.338 

.147 

.188 

.096 

.092 

6 

.277 

.096 

.076 

.269 

.228 

.054 

Mean 

.285 

.173 

.147 

.167 

.136 

.092 
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Table  8.   Relative  weights  of  dimensions, 
Regular  Army  recruiters 

Expert 

Dimension 

Communication   Demographic    Military  Personality  Behavior  Specific 
skills characteristics  background  characteristics experience 

7  .283         .098        .137  .250  .171  .061 

8  .437         .048        .035  .257  .106  .118 

9  .111         .172         .153  .296  .152  .116 

10  .546         .054        .105  .060  .214  .021 

11  .300         .120         .181  .155  .305  .020 

12  .448         .087        .092  .080  .118  .175 

13  .297         .007        .102  .275  .245  .075 

14  .381         .089        .089  .074  .208  .159 

15  .242         .167         .162  .221  .138  .071 

16  .402         .272        .119  .079  .057  .071 
Mean      .434         .049        .078  .194  .189  .056 
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Table  9.   Most/ieast  important  dimensions, 
Reserve  recruiters 


Expert 


Most 
important 


Second  most 
important 


Least 
important 


Demographic: 
characteristics 
.321 


C  ominun  i  ca  t  i  on 
skills 
.305 


Behavior 
characteristic 
.05 


Communication 
skills 
.299 


Specific 
experience 


Military 
background 

.045 


Communication 
.'  ills 
.245 


Demographic 
characterist  ics 
.191 


Military 
background 
.067 


Military 
background 

.517 


Communication 
skills 
.267 


Personality 
characterist i  c 

.023 


Demographic 
characteristics 
.338 


Personality 
characteristics 
.118 


Specific 

experience 
.054 


Communication 
skills 
.277 


Personality 
characteristics 
.269 


Specific 
experience 
.054 


Mean 


Commun  i  ca  t  i  on 
skills 

.277 


Demographic- 
characteristics 
.173 


Specific 
experience 
.099 
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Table  10.   Most/ least  important  dimensions,  Regular  Army  recruiters 


Expert 


Most 
important 


Second  most 
important 


Least 
important 


Communication 
skills 
.283 

Communication 
skills 
.437 


Personali  ty 
characteristics 
.250 

Personality 
characteristics 
.  257 


Specific 
experience 
.061 

Demographic 
characteristics 

.048 


Personality 
characterist  ics 
.296 


Demographic 
cha  "-act  eristics 
.172 


C ommun  i  ca  t  i  on 

skilis 
.ill 


10 


Communication 
skills 
.546 


Behavior 
.300 


Specific 

experience 

.021 


LI 


Behavior 
.305 


Communication 

skills 
.300 


Specific 
experience 
.020 


12 


Communication 
skills 
.448 


Specific 
experience 

.175 


Personality 
characteristics 
.080 


13 


Communication 

skills 
.297 


Personality 
characterist  ics 
.275 


Demographic 
characteristics 
.  075 


14 


Communication 
skills 
.381 


Behavior 
.208 


Personality 
characteristics 
.074 


15 


Communication 
skills 
.242 


Personality 
characteristics 


Specific 
experience 

.071 


16 


Communication 
skills 
.402 


Demographic 

characteristic: 
inn 

I  b  f  6 


Behavior 
.071 


Mean 


C  ommun  i  ca  t  i  on 

skills 
.434 


Personali  ty 
characteristics 
.194 


Demographic 
characterist  ics 
.0498 
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B.    Attributes 

The  importance  of  the  attributes  within  each  of  the  six  dimensions  is 
discussed  below.     Further  detail   for   all   attributes   within   dimensions 
contained  in  Appendix  A. 

1.    Communication  Skills 

The  attributes  within  the  Communication  Skills  dimension  are  Publ 
Speaking  Skills,  Writing  Skills,  Listening  Skills,  Informing,  and  Persuadin 
Table  11  displays  the  Reserve  experts'  judgments  about  the  attributes  of  t 
Communication  Skills  dimension.  Three  of  the  six  USAR  Recruiters  judg 
Persuading  most  important,  while  two  thought  Listening  was  most  important,  a 
one  felt  Informing  was  the  most  important  communication  skill.  Five  of  the  s 
USAR  Recruiters  felt  Writing  Skills  was  the  least  important  attribute  in  th 
dimension,  and  one  indicated  that  Public  Speaking  Skills  was  least  important. 

Similarly,  the  Active  recruiters  judged  Persuading  as  most  important 
seven  of  the  ten  cases,  as  shown  in  Table  12.  Two  felt  Listening  was  mo: 
important  and  one  considered  Informing  the  most  important  attribute  within  t] 
Communication  Skills  dimension.  The  Active  recruiters  also  felt  that  Writii 
Skills  were  least  important  in  half  the  cases.  Public  Speaking  Skills  wei 
selected  as  least  important  in  three  cases,  Persuading  in  one  case,  and  Informii 
in  one  case. 

2.    Personality  Characteristics 

The  Personality  Characteristics  dimension  includes  Self-Imag( 
Integrity,  Extroverted,  Sense  of  Humor,  and  People-Oriented.  As  shown  in  Tabit 
13  and  14,  both  the  USAR  and  Active  recruiters  consistently  identified  Integril 
as  the  most  important  attribute  within  the  Personality  Characteristics  dimensior 
Sense  of  Humor  and  People-Oriented  were  judged  as  the  least  important  attribute 
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Table  11.   Communication  skills  dimension, 
most/least  important  attributes,  Reserve  recruiters 


Expert  Most  Least 

important  important 


Informing  Writing 

.291  .063 


Listening  Writing 

.353  .028 


Persuading  Writing 

.357  .041 


Persuading  Writing 

. 467  . 088 


Listening  Writing 

.444  .051 


Persuading  Public 

speaking 
.397  .0i6 


Mean  Persuading  Writing 

.313  .041 
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Table  12.   Communication  skills  dimension, 
most/least  important  attributes,  Regular  Army  recruiters 


Expert 


Most 
important 


Least 
important 


Persuading 
.333 


Wri  ting 
.106 


Informing 
.319 


Persuading 
.083 


L0 


11 


12 


13 


14 


15 


16 


Mean 


Persuading 

.466 

Persuading 
.370 

Listening 

.318 

Persuading 

.450 

Persuading 

.440 

Listening 

.332 

Persuading 
.311 

Persuading 
.346 

Persuading 
.364 


Public 
speaking 

.056 

Writing 

.061 

Public- 
speaking 
.092 

Informing 
.079 

Writing 
.033 

Public 
speaking 

.085 

Writing 
.024 

Writing 
.024 

Writing 
.043 
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Table  13.   Personality  characteristics  dimension, 
most /least  important  attributes,  Reserve  recruiters 


Expert 


Most 
important 


Least 
important 


Self- image 

.314 


People  oriented 
.056 


Integrity 
.608 


Extroverted 
.033 


Integri  ty 

.449 


Sense?  of  humor 
.054 


Integrity 

/lOO 


Ext:  rover- i  ed 

.  061 


Integrity 
.507 


Sense  of  humor 
.030 


Integrity 
.358 


Extroverted 
.094 


Mean 


Integrity 
.540 


Sense  of  humor 

.  0784 
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Table  14.   Personality  characteristics  dimension, 
most/least  important  attributes,  Regular  Army  recruiters 


Expert 


Most 
important 


Least 
important 


Integrity 
.417 


Sense  of  humo 
.045 


Integrity 
.352 


Self-image 
.066 


Extroverted 
.339 


People  orient< 
.032 


10 


Integrity 
.537 


People  orient* 

.070 


11 


Integrity 
.348 


Sense  of  humo* 
.0784 


12 


Integrity 
.812 


Sense  of  humor 
.100 


13 


Integrity 
.505 


Sense  of  humor 
.032 


14 


Integrity 
.360 


People  oriente 
.062 


15 


Integrity 
.583 


Sense  of  humor 

.044 


16 


Integrity 
.618 


Sense  of  humor 
.039 


Mean 


Extroverted 
.507 


Sense  of  humor 
.064 
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within    this   dimension. 

3.  Behavior  Characteristics 

The  attributes  within  this  dimension  are  Self-Starter,  Commitment, 
Flexibility,  Attention  to  Detail,  and  Decisiveness.  Tables  15  and  16  reveal  the 
experts'  judgments  within  the  Behavior  Characteristics  dimension.  USAH  and 
Active  recruiters  again  agree  in  their  judgment  of  Self-starter  and  Commitment  as 
the  most  important  attribute  within  this  dimension.  Decisiveness  and  Flexibility 
appear  most  frequently  as  the  least  important  attribute. 

4.  Military  Background 

Military  Background  attributes  include  Paygrade,  Years  of  Service 
(Active)  and  Years  of  Service  (Reserve).  Among  these  attributes,  Tables  17  and 
18  indicate  that,  both  types  of  recruiters  judged  overall  experience,  as  indicated 
by  Paygrade,  to  be  most  important.  Reserve  recruiters  considered  Active  duty 
experience  least  important,  while  Active  Duty  Recruiters  gave  the  least  weight  to 
Reserve  experience. 

5.  Demographic  Characteristics 

The  attributes  within  the  Demographic  Characteristics  dimension  are 
Age,  Family  Support,  AFQT,  and  College  Experience.  Tables  19  and  20  presens 
evaluations  of  attributes  on  this  dimension.  AFQT  and  Family  Support  were 
consistently  judged  as  the  most  important  attribute  by  both  USAR  and  Active 
Recruiters.  Almost  all  of  the  recruiters  considered  Age  and  College  Experience 
relatively  unimportant. 

6.  Specific  Experience 

Specific  Experience;  includes  Sales  Experience,  Public  Speaking 
Experience,  and  Counselling  Experience.  As  indicated  in  Table  21,  Reserve 
recruiters  emphasized  the  importance  of  Sales  Experience  and  gave  the  next 

65 


Table  15.   Behavior  characteristics  dimension, 
most/least  important  attributes,  Reserve  recruiters 


Expert 


Most 
important 


Leas  t 
important 


Attention  to  detail 
.433 


Fiexibility 
.051 


Commitment 
.402 


Decisiveness 
.101 


Self-starter 
.328 


Decisiveness 

.041 


Self-starter 
.307 


Decisiveness 
.115 


Self-starter 
.251 


Flexibility 
.085 


Flexibility 
.289 


Attention  to  deta 
.093 


Mean 


Self-starter 
.301 


Decisiveness 
.076 
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Table  16.   Behavior  characteristics  dimension, 
most/least  important  attributes,  Regular  Army  recruiters 


Expert 


Most 
important 


Least 
important 


Self-starter 
.279 


Decisiveness 
.119 


Flexibility 
.380 


Decisiveness 
.060 


Self-starter 
.345 


Flexibility 
.034 


10 


Attention  to  detail 
.569 


Self-starter 
.  038 


li 


Self-starter 
N  .353 


Attention  to  acta 
.105 


12 


Self-starter 
.541 


Decisiveness 

.035 


13 


Commitment 
.504 


Attention  to  detail 
.105 


14 


Flexibility 
.332 


Flexibi  lity 
.098 


15 


Commitment 

.277 


Commitment 
.091 


16 


Attention  to  detail 
.458 


Attention  to  detail 
.059 


Mean 


Self-starter 
.312 


Decisiveness 
.087 
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Table  17.   Military  background  dimension, 
most/least  important  attributes,  Reserve  recruiters 


Expert  Most  Least 

important  important 


YOS(R)*  YOS(A)** 

.526  .237 


*  Years  of  service,  Reserve 
**Years  of  service,  Active  Duty 


Paygrade  YOS(A)** 

. 846  . 059 


All-3 
.333 


Paygrade 
.  472 


Paygrade 
.466 


Paygrade 
.561 


Mean  Paygrade 

.595 


YOS(A)** 

.  141 

YOS(A)** 

.294 

YOS(R)* 

.178 

YOS  (  A )  ** 

.097 
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Table  18.   Military  background  dimension, 
most/least  important  attributes,  Regular  Army  recruiters 


Expert  Most  Least 

important  important. 


7  Pay grade  YOS(R)* 

.  443  .  235 

8  YOS(A)**  Pay grade 

.456  .303 

9  Paygrade  YOS(R)* 

.624  .078 

10  YOS(A)**  YOS(R)* 

.566  .056 

11  Paygrade  YOS(R)* 

.625  .163 

12  YOS(A)**  YOS(H)* 

.811  .076 

13  Paygrade  YOS(R)* 

.422  .169 

14  Paygrade  YOS(R)* 

.562  .065 

15  YOS(A)**  YOS(R)* 

.618  .132 

16  YOS(A)**  Paygrade 

.440  .229 

Mean  YOS(A)**  YOS(R)* 

.498  .041 


*  Years  of  service,  Reserve 

**  Years  of  service,  Active  Duty 
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Table  19.   Demographic  characteristics  dimension, 
most/ least  important  attributes,  Reserve  recruiters 


Expert 


Most 
important 


Least 
important 


AFQT 
.370 


College  experienci 
.100 


Family  support 
.509 


Age 


.052 


AFQT 
.626 


Age 


.  027 


AFQT 


Age 


131 


AFQT 
.381 


Age 


.  048 


AFQT 
.445 


College  experience 
.098 


Mean 


AFQT 
.510 


Age 


029 


70 


Table  20.   Demograpic  characteristics  dimension, 
most/least  important  attributes,  Regular  Army  recruiters 


Expert 


Most 
important 


Least 
important 


AFQT 
.433 


Age 


038 


AFQT 
.414 


Family  support 

r\  ff  r^> 

.0/o 


AFQT 

,—  r-r  r-\ 

.  o  7  3 


Family  support 

.014 


10 


AFQT 
.456 


Age 


038 


11 


Family  support 
.360 


College  experience 

.108 


Family  support 
.361 


Age 


147 


13 


Family  support 
.492 


College  experience 
.090 


14 


AFQT 
.546 


College  experience 
.058 


15 


AFQT 
.432 


Age 


.132 


16 


AFQT 
.707 


Age 


078 


Mean 


AFQT 
.508 


Age 


107 
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Table  21.   Specific  experience  dimension, 
most/ least  important  attributes,  Reserve  recruiters 


Expert 


Most 
important 


Least 
important 


Sales 
.452 


Counselling 
.239 


Counselling 
.569 


Public  speaking 
.544 


All-3 
.333 


Sales 
.582 


Counselling 

.210 


Counselling 
.506 


Sales 
.350 


Sales 
.422 


Public  speaking 
.285 


Mean 


Sales 

.452 


Public  speaking 

.  <-  —  o 
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highest  weight   to  Counselling  Experience.   Regular  Army  recruiters,  on  the  other 
hand,  did  not  distinguish  among  these  attributes  in   a  consistent   manner.    See 
Table  22). 
C.    Evaluation  of  Experts 

The  expert  systems  developed  for  the  sixteen  recruiter  experts  may  be 
evaluated  and  compared  in  terms  of  Fidelity,  Standards,  and  Discrimination. 
These  criteria  are  explained  in  detail  in  Chapter  III.  The  indices  which  reflect 
these  concepts  range  in  value  from  zero  to  100,  though  the  expert  system  program 
does  not  incorporate  a  normalization  process  and  the  values  sometimes  exceed  100 
or  go  below  zero. 

The  Fidelity  index  measures  how  well  the  expert  system  correctly  reproduces 
the  experts'  intuitive  judgments,  the  Standards  index  measures  the  extent  to 
which  the  experts  maintain  high  standards  on  their  assessments  of  profiles  of 
recruiters,  and  the  discrimination  index  measures  the  experts'  ability  to  make 
fine  distinctions  among  profiles  of  recruiters.  The  user  of  the  system  must 
determine  an  optimal  or  acceptable  combination  of  values  for  these  measures. 

Appendix  B  displays  the  three  indices,  the  mean  squared  error,  and  the 
explained  variance  in  each  of  the  six  dimensions  and  the  overall  model  for  each 
of  the  sixteen   expert  systems.   Table  23  summarizes  this  information. 

For  the  overall  model,  the  Fidelity  Index  was  above  90  in  eleven  cases  and 
above  83  in  the  remaining  five  cases.  For  the  individual  dimensions 
(Communication  Skills,  Demographic  Characteristics,  Military  Background, 
Personality,  Behavior,  and  Specific  Experience),  the  Fidelity  [ndex  remained 
above  80  in  all  but  seven  cases. 

For  the  overfill  model,  the  expert's  Standards  indices  ranged  from  17.0  Lo 
99.3.   A  regular  active  duty  recruiter  (RA)  Instructor/Guidance  Counselor  was  the 
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Table  22.   Specific  experience  dimension, 
most/least  important  attributes,  Regular  Army  recruiters 


Expert 


Most 
important 


Least 
important 


Counselling 
.647 


Public  speaking 
.153 


Public  speaking" 
.453 


Sales 
.223 


Sales 

.470 


Counselling 
.  205 


10 


Public  speaking 
.448 


Sales 
.261 


11 


Counselling 

.313 


Sales 
.313 


12 


Sales 

.715 


Counselling 
.093 


13 


Counselling 

.416 


Public  speaking 
.235 


14 


Public  speaking 
.520 


Counselling 
.232 


15 


Counselling 
.488 


Sales 
.197 


16 


Sales 

.540 


Counselling 

.115 


Mean 


Public  speaking 
.390 


Counsel ling 
.264 
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Table  23.   Mean  validity  index  scores 
for  expert  systems 


Reserve  recruiters  (n-6) 


Overall  profile 

Communication  skills 

Demographic 
characteristics 

Military  background 

Personality 
characteristics 

Behavior 

char ac  t er is  t  i  cs 

Specific  experience 


Fidelity  index   Standards  index   Discrimination  Index 
91.8  73.7  60.0 

91.7  62.5  76.3 


92.6 
91.9 

92.9 

91.8 
91.  7 


58.7 

47.5 

72.6 

64 . 8 
46.7 


67.8 

41.8 

71.8 

57.3 
36.7 


Regular  Army  recruiters  ( n - 1 0 ) 


Overall  profile 

Communication  skills 

Demographic 
charac  t er  i  s  t  i cs 

Military  background 

Personality 
characteristics 

Behavior 
characteristics 

Specific  experience 


91.9 

60.2 

90.9 

54.4 

90.8 

51.4 

90.0 

48.3 

89.1 

90.6 
93.6 


67.5 


65 . 1 


42. 


79.1 
80.  I 

74 . 2 
66.5 

87.9 

76.5 
65 .  3 
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most  lenient,  and  a  USAR  Recruiter  Instructor  had  the  highest  Standards  index. 
The  Standards  indices  for  the  individual  dimensions  varied  widely,  but  those 
experts  whose  Standards  indices  were  high  for  the  overall  model  tended  to  have 
higher  indices  than  the  other  experts  for  the  individual  dimensions  as  well. 

The  experts'  Discrimination  indices  ranged  from  18.1  to  103.8.   Expert  12,  a 
RA  Instructor/Guidance  counselor,  had  the  highest  Discrimination  index.   Expert 
1,  a  USAR  field  recruiter,  had  the  lowest. 
D.   Composite  Models 

In  order  to  obtain  composite  models,  two  different  methodologies  were  used. 

1.   Models  Based  on  Means 

Two  separate  models  were  developed  using  mean  values,  one  for  Reserve 
recruiters  (MAGR)  and  one  for  Active  Duty  (MRA)  recruiters.  To  construct  these 
models,  all  assessments  from  each  expert  were  sorted  by  concept  and  response  and 
the  means  of  the  responses  were  calculated.  These  mean  values  were  then  entered 
into  the  expert  system  program  to  create  a  composite  expert.  The  overall  model 
was  constructed  by  weighting  the  individual  dimensions.  It  is  not  the  simple 
arithmitic  mean  of  the  component  dimensions. 

For  both  RA  and  USAR  mean  expert  systems,   the  overall  model  Fidelity 
Index  was  97,  and  was  at  least  96  for  the  individual  dimensions.   The  Standards 
Index  for  the  overall  model  was  60  for  the  Reserves,   with  the  individual 
dimensions  ranging  from  48.3  to  67.5.   The  Active  Duty  Standards  Index  was  74  for 
the  overall  model,  and  ranged  from  46.3  to  74  for  the  individual  dimensions. 
Finally,  the  Discrimination  Index  for  the  Reserves  was  62  for  the  overall  model, 
and  varied  from  53   to  68  on   the   individual  dimensions.    The  Active  Duty 
recruiters  were  less  discriminatory  with  an  index  of  41  for  the  overall  model, 
and  a  range  of  38  to  65  for  the  individual  dimensions.    As  expected,   the  use  of 
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mean  input  values  stabilizes  the  disparities  between  individual  experts  by 
creating  an  "average"  expert  system.  The  mean  expert  is  included  in  Tables  10 
through  22  for  comparison  and  summary  purposes. 

2.    Patchwork  Models 

The  expert  systems  program  contains  a  feature  which  allows  the  user-  to 
create  a  composite  model  using  the  responses  of  experts  who  have  been  interviewed 
previously.  The  user  can  "patch"  experts  to  concepts  or  dimensions  based  on  any 
criteria.  For  this  exercise  the  criteria  have  been  specified  with  a  high 
fidelity  index  (as  close  to  100  as  possible),  a  normal  (around  50)  Standards 
Index,  and  a  normal  (around  50)  Discrimination  Index.  There  is  no  "ideal" 
criteria.  For  example,  Expert  I  meets  the  criteria  for  Coirununicat  ion  Skills, 
(that  is,  high  Fidelity,  normal  Standards,  and  normal  Discrimination  Indices;. 
However,  Expert  1's  assessment  on  Personality  Characteristics  is  below  the 
minimum  criteria.  Expert  2,  on  the  other  hand,  meets  the  criterLa  for 
Personality  Characteristics.  The  system  allows  the  inclusion  only  of  experts  who 
meet  the  specified  standard  and  may  then  be  used  to  select  recruiters  based  on 
this  composite  model. 
E.    Comparing  the  Expert  Systems 

The  expert  systems  for  the  6  Reserve  experts,  the  10  Active  Duty  experts, 
and  the  mean  and  patchwork  models  for  Reserve  and  Active  Duty  recruiters,  were 
used  to  evaluate  a  set  of  twenty  hypothetical  recruiter  applicants.  Subjective 
assessments  were  made  to  determine  "realistic"  measures  for  the  attributes. 

Appendix  C  displays  the  profiles  of  the  twenty  hypothetical  recruiter- 
candidates.  The  profiles  were  designed  such  that  some  of  the  applicants  are  at 
the  top  end  of  the  rating  scale  (0-99)  and  some  at  the  bottom  on  all  attributes. 
Random  assignment  would  not  have  generated   "realistic"  candidates,   nor  would  it 
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have  resulted  in  meaningful  tests  of  validity  for  the  expert  systems.  The: 
cases  illustrate  how  judgments  are  affected  by  the  Standards  index.  Exper 
who  have  high  standards  tend  to  assign  lower  ratings  than  more  leniei 
experts.  The  remainder  of  the  recruiter  applicants  meet  the  minimum  requiremen 
set  by  the  Army: 

1.  At   least   a  high  school   diploma  graduate   or  GE1)  with  one  year 
college; 

2.  Minimum  GT  score  of  110  waiverable  to  100; 

3.  Between  21  and  35  years  of  age; 

4.  In  paygrades  E-5,  E-6,  or  E-7  (E-7's  may  have  no  more  than  2  years  tii 
in  grade  at  time  of  selection). 

The  minimum  ac  ^  .able  rating  on  any  scale  for  the  program  is  45. 

Tables  24  and  25   summarize  the  results  of  the  expert  systems  evaluation  < 

the  hypothetical  candidates.   Detailed  descriptions   of  these  evaluations  appej 

in   Appendix   D.     Asterisks   indicate   the   rejected  applicants  (below  45).  i 

expected,  the  results  are   very  similar   for  the  Reserve  expert   systems  and  U 

Active  expert   systems.    In  almost  every  case>  the  top  five  applicants  are  B,  I 

E,  C,  and  0.   Every  system  rejects  A,  K,  and  N  and  they  appear  as   the  last  flirt 

applicants.    There  are  some  inconsistencies  in  the  results,  however.   Candidal 

B,  for  example,  is   rejected  in   some  overall   models,  though  he  is   superior  i 

every  dimension.    This   reflects  the   very  high  Standards  index  for  some  of  tl 

systems  which  rejected  more  than  half  of  the  applicants. 

Some  interesting  results  may  be  seen   in  the  comparisons  of   the  mean  USA 

models  (MAGR  and  MRA)   and  the  patchwork  models   (PAGR  and  PRA).   The  mean  an 

patchwork  models  for  USAR  recruiter  experts  are  quite  dissimilar.    Although  bot 

Reserve  composite  models  select  Applicant  E,  for  example,  MAGR  ranks  E  as  numbc 

one,  while  PAGR  ranks  E   as   number  seven.     However,   MAGR's   rating"   for  thi 

applicant  is   60  as   opposed  to   AGRl's  rating  of  62.8.    This   is  an  example  o 

MAGR's  high  standards.   MAGR  rejects  thirteen  of  the  twenty  applicants  while  PAG 
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rejects  only  four. 

In  contrast,  MRA  and  PHA  (the  Active  Duty  composite  models) are  surprisingly 
similar.  They  both  rank  B  and  L  first  and  second,  respectively.  Similarly,  MRA 
and  PRA  reject  applicants,  U,  F,  G,  K,  N,  and  A  In  exactly  the  same  order  with 
similar  ratings.   PRA  also  rejects  H,  T,  and  D,  however,  while  MRA  selects  them. 
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Table  24.   Expert  systems  evaluations  of  hypothetical 
applicants,  Reserve  recruiters 


Expert 
Ranking 


MAGR 


10 


11 


12 


13 


14 


B 
49.5 

B 
62.2 

B 

74.3 

L 
55.0 

L 
55.6 

B 
73.2 

E 
60.0 

L 

49.2 

E 
60.3 

L 

68.6 

S 
53.6 

I 
51.3 

L 
72.1 

L 
49.2 

I 
49.0 

M 
60.2 

M 
63.0 

E 
53.3 

B 
50.5 

S 
67.6 

S 
48.5 

E 
48.6 

L 

59.3 

J 
60.5 

I 
53.3 

C 
47.0 

I 
66.5 

J 
48.5 

S 
48.1 

I 

58.4 

I 
60.0 

0 
53.2 

0 
46.3 

0 
64.9 

C 
48.3 

P 

47.9 

0 
58.3 

S 
58.9 

B 
53.1 

S 
44.9* 

C 
62.6 

I 
47 . 9 

M 

47.9 

P 
56.6 

0 
55.3 

M 
52.5 

E 
42.7* 

E 
61.4 

0 
47.5 

C 
47.8 

C 
54.7 

E 
54.6 

C 
52.4 

P 

41.9* 

P 
59.7 

M 
42.8* 

0 
47.6 

S 
52.6 

C 
54.3 

P 
51.3 

D 

41.0* 

J 
59.3 

B 
41.0* 

T 
47.0 

H 
48.3 

P 
53.9 

J 
49.8 

H 
39.9* 

M 
58.2 

T 
40.3* 

J 
46.9 

J 

47.4 

V 
48.8 

H 

48.0 

M 
38.0* 

D 
57.1 

P 
39.3* 

H 

46.7 

V 
45.3 

H 

44.0* 

T 
45 . 5 

F 
36.9* 

T 
53.8 

II 
38.4* 

G 
46.3 

F 

38.8* 

T 
43.2* 

D 

45 . 2 

J 
35.9* 

V 
53.5 

U 
29.5* 

D 
46.3 

G 
37.5* 

D 
42.1* 

V 
42.6* 

T 

34.8* 

H 
53.5 

F 
26.0* 
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Table  24.    (Continued) 

Expert  12  3  4  5  6  MAGfi  PAGH 

Ranking 

VDUU.GFDV 

15  45.8         35.5*       40.8*       41.6*       33.3*       48.5  23.5*       47.6 

UTFFVUVU 

16  45.4  33.2*        38.2*       41.1*        29.5*       44.6*        15.0*        45.8 

FUGGUGGG 

17  45.0  31.5*        38.3*       40.6*        41.6*        42.3*        14.1*        38.9* 

K  A  K  K  K  K  A  K 

18  43.3*        1.0*  13.0*        26.9*        18.7*        20.6*        i.0*  21.0* 

N  K  N  N  N  N  X  N 

19  42.6*        1.0*  7.5*  15.5*        10.3*        16.1*        1.0*  13.7* 

A  N  A  A  A  A  N  A 

20  41.0  1.0*  1.0*  1.0*  13.5*        i.0*  1.0*  1.0* 


♦Rejected  by  expert   system;    score  below  45. 
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Table  25.   Expert  systems  evaluations  of 
hypothetical  applicants,  Regular  Army  recruiters 

Expert    7     8     9     10    11     12    13     14     L5     16    MRA   P 

Choice 

BBLLBEBEBBBfl 

1  62.2     49.5     55.6     55.0     74.3      60.0     74.3     60.0      73.2      83.1      73.4     74 

ELISLLLLLPLL 

2  60.3     49.2     51.3     53.6     68.6     49.2     68.6     49.2     72.1     76.6     69.9     68 

MIBEMSMSSLIM 

3  60.2     49.0     50.5     53.3      63.0     48.5      63.0     48.5      67.6     70.1      66.9     64 

LECIJJJJI  I  E  I 

4  59.3     48.6     47.0     53.3     60.5     48.5     60.5     48.5     66.5     64.3     64.5     60 

IS00ICIC000S 

5  58.4     48.1     46.3     53.2     60.0     48.3      60.0     48.3      64.9     56.3      63.4     59 

OPS*BSISIC  M  M  J 

6  58.3     47.9     44.9     53.1     58.9     47.9     58.9     47.9     62.6     56.3      63.2     59 

PME*M0000EEJ0 

7  56.6     47.9     42.7     52.5     55.3     47.5     55.3     47.5      61.4     53.8     62.5     56 

CCP*CEM*EM*PCPC 

8  54.7     47.8     41.9     52.4     54.6     42.8     54.6     42.8     59.7     48.2     62.3     55 

SOD*PCB*CB*JTCE 


H            T            H*          J  P  T*  P            Y*          M             F*          S  P 

10  48.3  47.0  39.9  49.8  53.9  40.3  53.9  40.3  58.2  43.0  60.6  51 

J            J            M*          H  V  P*  V            P*          D             H*          T  V 

11  47.4  46.9  38.0  48.0  48.8  39.3  48.8  39.3  57.1  39.5  55.9  50. 

V             H             F*           T  H*  H*  H*           H*           T             J*           H  H> 

12  45.3  46.7  36.9  45.5  44.0  38.4  44.0  38.4  53.8  39.1  53.0  44. 

F*          G            J*          D  T*  U*  T*          U*          V             V*          D  Tl 

13  38.8  46.3  35.9  45.2  43.2  29.5  43.2  29.5  53.5  37.8  51.4  42. 

G*           D             T*           V*  D*  F*  D*           F*           H             0*           V  dI 

14  37.5  46.3  34.8  42.6  42.1  26.0  42.1  26.0  53.5  29.9  46.2  42. 

D*           V  G*           U*  U*  D*  U*           0*           F             S*           U*  Ul 

15  35.5  45.8  33.3  41.6  40.8  23.5  40.8  23.5  48.5  28.4  43.2  40. 
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Table  25.  (Continued) 

Expert   7  8     9     10  11  12  13  14  15    16  MRA   PRA 
Choice 

T*  U     V*  F*  F*  V*  F*  V*  U*    G*  F*    F* 

16  33.2  45.4  29.5  41.1  38.2  15.0  38.2  15.0  44.6  26.7  42.8  39.1 

U*  F     U*  G*  G*  G*  G*  G*  G*    D*  G*    G* 

17  31.5  45.0  24.1  40.6  28.3  14.1  28.3  14.1  42.3  25.1  37.4  27.7 

A*  K*    K*  K*  K*  A*  K*  A*  K*    K*  K*    K* 

18  1.0  43.3  18.7  26.9  13.0  1.0  13.0  1.0  20.6  17.2  18.5  10.5 

K*  N*    N*  N*  N*  K*  N*  K*  N*    A*  N*    N* 

19  1.0  42.6  10.3  15.5  7.5  1.0  7.5  1.0  16.1  8.1  10.4  4.5 

N*  A*    A*  A*  A*  N*  A*  N*  A*    N*  A*    A* 

20  1.0  41.0  8.5  9.1  1.0  1.0  1.0  1.0  1.0  1.0  1.0  1.0 


^Rejected  by  expert  system;  score  below  45. 
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V.   CONCLUSIONS  AND  RECOMMENDATIONS 

A.  Past  research 

The  literature  review  in  Chapter  II  indicates  that  two  categories  of  factors 
have  been  identified  for  their  utility  in  predicting  successful  recruiter 
performance.  One  grouping  includes  biographical  and  personal  history 
characteristics  (age,  education,  entrance  test  scores,  gender,  marital  status, 
etc.)  which  are  available  in  standard  military  personnel  files.  The  predictive 
utility  of  these  factors  has  been  found  to  differ  widely  among  studies  as  a 
consequence  of  the  specific  predictors  selected  and  the  criterion  predicted. 

The  second  group  of  factors  shown  to  be  valuable  in  estimating  recruiter 
success  is  comprised  of  measures  of  personality  and  behavioral  traits.  Measures 
of  such  characteristics  as  dominance,  self-confidence,  vocational  interest  and 
verbal  ability  are  much  more  difficult  to  obtain.  Likewise,  this  set  of  factors 
has  yielded  disappointing  predictive  results.  Difficulty  in  conceptualizing 
predictor-criterion  relationships  and  in  devising  objective  criterion  measures 
has  limited  the  value  of  conventional  approaches  to  the  problem  of  predicting 
recruiter  success. 

B.  Expert  Systems 

This  study  applies  a  relatively  new  methodology,  expert  systems,  to  the 
recruiter  selection  problem.  This  technology,  a  branch  of  artificial 
intelligence,  has  proved  particularly  useful  in  dealing  with  problems  involving 
incomplete  knowledge  and  subjective  judgment.  The  expert  system  shell  selected 
for  this  project  is  intended  for  moderately  difficult  and  repetitive  decision 
problems.  It  allows  efficient  interaction  of  experts  with  a  knowledge  base  and 
can  be  applied  to  the  development  of  models  for  recruiter  selection.  The  program 
is  described  in  detail  in  Chapter  III. 
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The  expert  systems  approach  addresses  a  major  shortcoming  of  traditional 
analysis  -  the  failure  to  specify  the  relative  importance  of  recruiter 
attributes.  A  weighting  algorithm  imbedded  in  the  expert  system  shell  produces  a 
multi-attribute  utility  model  from  the  expert's  evaluation  of  hypothetical 
recruiter  candidates. 

A  second  important  advantage  of  expert  systems  technology  is  the  lack  of 
reliance  on  an  objectively  measured  criterion  for  recruiter  success.  This 
approach  avoids  the  problem  of  poorly  specified  and  measured  performance  criteria 
which  has  limited  the  usefulness  of  many  previous  efforts  to  model  recruiting 
success . 

Expert  systems  were  developed  for  6  Active  Guard  and  Reserve  (AGR)  Army 
recruiters  and  for  10  Regular  Army  (RA)  recruiters.  In  addition,  overall  models 
were  constructed  for  Reserve  and  Active  recruiters  as  well  as  two  composite 
models.  The  validity  of  the  systems  was  evaluated  by  the  expert  systems  program 
itself  on  the  basis  of  three  indices:  fidelity,  standards,  and  discrimination. 
All  the  systems  developed  for  recruiter  experts  showed  high  scores  for  these 
tests.  Twenty  hypothetical  recruiter  applicants  were  screened  by  each  of  the 
expert  systems  and  a  fairly  consistent  pattern  of  selection  and  rejection 
emerged,  with  a  few  exceptions.  Chapter  IV  described  these  results. 
C.   Profile  of  the  Successful  Recruiter 

The  characteristics  of  a  successful  recruiter  may  be  inferred  from  the 
weights  assigned  to  individual  attributes  within  the  dimensions  identified  by  the 
expert  systems.  Recruiter  attributes  are  grouped  into  six  dimensions: 
Communication  Skills,  Personality  Characteristics,  Behavior  Characteristics, 
Military  Background,  Demographic  Characteristics,  and  Specific  Experience.  This 
hierarchy  of  attributes  is  based  on  the  findings  of  previous  studies  and  also 
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upon  the  opinions  of  experts  in  the  recruiting  field.  It  includes  both  the 
biodemographic  factors  and  the  personality/behavior  traits  identified  by  earlier 
researchers. 

On  the  whole,  Reserve  recruiters  judged  Communication  Skills,  Demographic 
Characteristics,  and  Personality  Characteristics  to  be  the  most  important 
dimensions  for  successful  recruiting,  while  Active  recruiters  felt  that 
Communication  Skills,  Personality  Characteristics,  and  Behavior  Characteristics 
were  most  important. 

Within  the  six  digressions,  Reserve  recruiters  judged  Persuading  to  be  the 
most  important  Communication  Skill,  Integrity  to  be  the  most  important 
Personality  trait,  Self-starter  to  be  the  most  important  Behavior  Characteristic, 
Paygrade  to  be  the  most  important  aspect  of  Military  Background,  AFQT  to  be  the 
leading  Demographic  Characteristic,  and  Sales  Experience  to  be  the  most  useful 
type  of  Specific  Experience. 

Active  recruiters  made  generally  similar  judgments  as  to  the  roles  of 
attributes  in  the  dimensional  hierarchy:  Persuading,  Integrity, Self-starter,  and 
AFQT  were  all  considered  most  important  within  their  respective  dimensions,  while 
Years  of  Service  (Active  Duty)  and  Public  Speaking  Experience  had  the  strongest 
support  within  the  Military  Background  and  Specific  Experience  categories. 

Reserve  recruiter  -  experts,  then,  see  a  potentially  successful  candidate  as 
an  individual  who  is  intelligent,  persuasive,  self-moxivated,  high-ranking  for 
his  or  her  length-of-service,  and  who  has  some  sales  experience.  Active 
recruiters  have  a  similar  ideal  candidate  who  possesses  public  speaking 
experience  rather  than  sales  experience  and  has  many  years  of  service  (Active 
Duty)  rather  than  high  rank,  but  with  otherwise  identical  characteristics. 
However,  these  profiles  are  far  too  limiting  in  that  the  expert  systems  models 
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give  a  role  to  every  attribute  in  the  hierarchy  and  develop  an  internally 
consistent  selection  tool  reflecting  all  of  the  characteristics. 
D.   Measurement  of  Personality/Behavior  Attributes 

A  major  impediment  to  the  implementation  of  expert  systems  methods  for 
recruiter  selection  is  the  lack  of  individual  data  on  personality  and  behavioral 
characteristics.  There  are  a  number  of  instruments  which  are  designed  to  measure 
such  traits  and  which  would  be  accommodated  readily  into  the  recruiter  screening 
process.  Several  of  these  widely  used  instruments  are  described  below, 
a.   Myers-Briggs  Type  Indicator  (MBTI) 

The  MBTI  test  measures  of  four  dichotomous  indices  of  personality  type: 
Extraversion-Introversion  (EI),  whether  perception  and  judgment  are  directed 
toward  the  environment  or  the  world  of  ideas;  Sensation-Intuition  (SN) , 
indicating  dominant  perceptual  style;  Thinking-Feeling  (TF),  which  one  of  these 
two  modes  of  judgment  is  relied  upon;  and  Judgment-Perception  ( JP) ,  indicating 
which  of  these  is  relied  upon  in  dealing  with  the  environment.  The  test  consists 
of  166  forced-choice  (usually  two)  items.  Fifty-two  items  are  word  pairs  in 
which  respondents  indicate  a  preference.  Some  of  the  pairs  are  theory-certainty, 
build-invent,  casual-correct,  who-what,  sign-symbol  or  similar  to  the  following: 

Do  you: 

(1)  prefer  to  do  things  at  the  last  minute 

(2)  find  it  hard  on  your  nerves 

The  test  is  self-administering  and  has  no  time  limit,  but  usually  takes  about  50 
minutes  to  complete.  The  MBTI  is  easy  to  administer  and  score,  and  the  types  do 
have  the  virtue  of  being  mutually  independent.  A  draw-back  is  that  it  measures  a 
only  two  of  the  attributes  identified  (extrovert  and  self-image)  [Ref.  18;  pp. 
186-189] . 
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b.   California  Psychological  Inventory  (CPI) 

The  CPI  groups  eighteen  variables  under  four  classifications:  Class  ] 
measures  poise,  ascendancy,  and  self-assurance;  Class  II  measures  socialization, 
maturity,  and  responsibility;  Class  III  measures  achievement,  potential  and 
intellectual  efficiency;  and  Class  IV  measures  personal  orientation  and  attitudes 
toward  life.  This  single  test  measures  most  of  the  attributes  identified  in  the 
expert  system  approach  to  profiling  the  successful  recruiter.  It  includes 
measures  of  self-starter,  extroverted,  people-oriented,  self-image,  flexibility, 
commitment,  and  indirectly,  integrity.  Integrity  could  be  measured  using  the 
variables,  responsibility  and  socialization.  They  are  defined  by  the  CPI  as 
follows: 

(1)  responsibility — indicating  seriousness  of  thought  and  manner, 
conscientiousness,  dependability  and  uprightness;  being  the  kind 
of  person  that  others  tend  to  trust  and  to  rely  upon. 

(2)  socialization — indicating  a  strong  sense  of  probity  and  propriety; 
acceptance  of  rules,  proper  authority,  and  custom;  a  person  who 
seldom  if  ever  gets  into  trouble. 

The  CPI  is  essentially  self-administering  and  consists  of  480 
statements.  The  18  scales  are  normative  and  are  based  on  over  6,000  males  and 
7,000  females.  The  raw  scores  are  converted  to  profiles  which  provide  graphic 
representations  of  standard  scores. 

Convincing  evidence  exists  to  validate  each  of  the  18  scales.   Even 
attributes  such  as  self-acceptance  revealed  significant  differentiation  between 
high  school  students  rated  as  high  and  low  on  self-acceptance  by  staff  assess- 
ment ratings  [Ref.  18;  pp.  37-40]. 
c.    The  16  PF 

The  16  PF  is  a  personality  test  designed  to  measure  an  individual's 
personality  in  terms  of  sixteen  basic  factors.    It  was  used  successfully  in  a 
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predictor  battery  for  a  Marine  Corps  Study  conducted  by  Larriva  [Ref.  15]. 
Several  of  the  factors  measured  by  the  16  PF  have  been  associated  with  recruiter 
success.  These  include  dominance,  aggressiveness,  self-confidence,  and 
spontaneity. 

E.  Testing  the  model 
The  expert  systems  approach  is  very  flexible.   An  appropriate  expert  system 

may  be  developed  and  tested  based  on  any  criteria  set  forth  by  the  Recruiting 
Command.  The  nature  and  structure  of  the  hierarchy  of  attributes  within 
dimensions  can  be  modified  easily.  An  expert  or  a  set  of  experts  could  be 
selected  and  the  program  used  to  extract  the  knowledge  necessary  for  use  in 
building  a  system  to  narrow  a  field  of  potential  recruiters. 

Initial  testing  might,  involve  applying  the  model  to  recruiter  trainees  at 
entry  to  recruiter  training  school  and  then  tracking  the  performance  of  these 
students.  The  model  could  be  refined  and  modified  on  the  basis  of  such  tests. 
Finally,  the  model  would  then  be  useful  as  a  decision  support  element  at  the 
selection  board  level  or  at  the  Recruiting  Command  level.  Modification  of  the 
dimensional  hierarchy  or  the  expansion  of  the  knowledge  base  through  the 
inclusion  of  alternative  or  additional  experts  are  both  easily  accomplished  with 
the  expert  system  shell. 

F.  Work  remaining 
The  application  of  expert  systems  technology  to  problems  of  personnel 

selection  is  in  the  very  early  stages  of  development.  The  artificial 
intelligence  field  itself  is  rapidly  advancing  and  promises  to  provide  solutions 
to  many  difficult  questions.  Currently,  however,  there  are  severe  limitations  to 
the  usefulness  of  these  methods  in  solving  so  complex  a  problem  as  recruiter 
selection.    The  model  developed  here  does  succeed,   to  a  great  extent,  in 
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assigning  weights  to  personal  attributes  in  an  objective  manner  within  the 
context  of  an  unspecified  criterion  for  recruiter  success.  It  does  not,  however, 
simulate  the  intricate  processes  of  human  reasoning  which  are  involved  in  the 
selection  of  essential  personnel  by  a  large  organization. 

The  work  presented  here  is  preliminary  and  cannot  advance  without  the 
development  of  expert  systems  techniques  to  accommodate  the  complex  nature  of 
such  decisions.  Expert  systems  is,  however,  a  very  promising  tool,  and  even  at 
this  early  point  of  development,  it  can  provide  assistance  in  structuring  the 
difficult  recruiter  selection  decision. 

There  are  several  areas  for  future  work.  One  is  the  construction  of  expert 
systems  shells  which  better  suit  the  specific  decision  problem  and  a  tailoring  of 
the  knowledge  acquisition  aspect  of  the  programs  to  suit  the  recruiter  experts. 
A  second  area  for  further  work  is  the  measurement  of  personality  and  behavior 
traits  for  recruiter  candidates  so  that  these  values  can  be  used  in  testing 
expert  systems  models.  A  third  task  is  the  continuation  of  research  into  the 
characteristics  associated  with  recruiter  success.  The  hierarchies  which  provide 
the  basic  structure  for  the  expert  systems  model  must  come  from  knowledge  of  the 
dynamics  of  the  recruiting  process. 
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APPENDIX  A 
The  Expert   Systems;      Profiles  of  'the  Successful  Recruiter   by  Expert 


Expert    #1 
Communication    Skills 


30.49 

Public  Speaking 

Skills 

28, 

.19 

Writing  Skills 

6, 

.25 

Listening  Skills 

25, 

.03 

Informing 

29, 

.13 

Persuading 

11, 

.39 

Military  Backqround 

6.93 

Paygrade 

23, 

.72 

Years  of  Svc. 

(Act. ) 

23 

.72 

Years  of  Svc. 

(Res. ) 

52, 

.55 

Behavior    Characteristics 


4.95 

Self-Starter 

Commitment 

Flexibi 1 ity 

Attention  to 
Detail 

Decisiveness 


19.50 


17.45 


5.13 


43.33 


14  .58 


Demographic  Character  is tics 
32.09 


Age 

Family  Support 

AFQT 


19.17 


33.82 


37.01 


College  Experience    10 .00 


Personality  Characteristics 


19.01 

Self-image 

31. 

,38 

Integrity 

29, 

.43 

Extroverted 

17, 

.27 

Sense  of  Humor 

16. 

,36 

People -Or iented 

5, 

.56 

Specific  Experience 

6.53 

Sales  Experience 

45, 

.18 

Public  Speaking 

Exp. 

30. 

90 

Counselling  Exp. 

23, 

.92 
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Profile  of  the  Successful  Recruiter 
Expert  #2. 
Communication  Skills 


29.90 

Public  Speaking 
Skills 

Writing  Skills 


Informing 
Persuading 


8.34 


2.84 


Listening  Skills   35.  34 


25.34 


27.64 


Demographic  Characteristics 
17.63 


Age 

Family  Support 

AFQT 


5.24 


50.39 


38.22 


College  Experience     5 . 65 


Mi litary  Background 
4.52 

Paygrade  84.57 

Years  of  Svc. 

(Act.)  5.86 

Years  of  Svc. 

(Res.)  9.57 


Personality  Characteristics 
12.32 


Self-image 
Integrity 
Extroverted 
Sense  of  Humor 
People -Or iented 


17.95 


60.84 


2.90 


10.66 


7.65 


Behavior  Characteristics 


12.27 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


21.82 


40.21 


16.49 


11.43 


10.06 


Specific  Experience 
22.87 

Sales  Experience 


37.65 


Public  Speaking  Exp.   5.44 
Counselling  Exp.      56.91 
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Profile  of  the  Successful  Recruiter 


Expert  #3. 

Communication  Skills 
24.52 

Public  Speaking 

Skills  9.93 

Writing  Skills      4.09 

Listening  Skills   23 . 53 


Informing 
Persuading 


26.74 


35.66 


Demographic  Character  i sties 
19.09 


Age 

Family  Support 

AFQT 

College  Experience 


7.36 


Military  Background 
6.71 


Personality  Characteristics 


Paygrade 


33.33 


Years  of  Svc. 

(Act.)  33.33 

Years  of  Svc. 

(Res.)  33.33 


18.75 

» 

Self-image 

24. 

.16 

Integrity 

44, 

.91 

Extroverted 

14, 

.20 

Sense  of  Humor 

5, 

,  43 

People -Or iented 

11 

.30 

Behavior  Characteristics 


12.69 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decisiveness 


32.82 


12.27 


20.76 


30.01 


4.14 


Specific  Experience 
18.23 

Sales  Experience 


33.33 


Public  Speaking  Exp.  33 .  33 
Counselling  Exp.      33.33 
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Prof  ile  of  the  Successful  Recruiter 
Expert  #4. 
Communication  Skills 


26.68 

Public  Speaking 

Skills  10.26 


Writing  Skills 


8.78 


Listenir.-j  Skill?  12  .  21 
Informing  21 . 08 
Persuading        46  .  67 


Demographic  Characteristics 
5.18 

Age  13.08 

Family  Support  22 . 69 

AFQ7  38 . 33 

College  Experience  25.90 


Military  Background 
51.73 

Fctygrade  38  .  70 

Years  of  Svc. 

(Act.)  14 .03 

Years  of  Svc. 

(Res.)  47.22 


Personality  Characteristics 
2.30 


Self-image 
Integrity 
Extroverted 
St=n=>o  of  Humor 
People -Or iented 


14 

48 

43 

.22 

6 

.07 

16 

19 

20 

.03 

Behavior  Characteristics 


8.62 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


30.67 


13.89 


2  8.54 


15.41 


11.48 


Specif  ic  Experience 
5.  49 

Sales  Experience 


58.17 


Public  Speaking  Exp.  20 . 99 
Counselling  Exp.      20  .  84 
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Profile  of  the  Successful  Recruiter 


Expert  #5. 

Communication  Skills 
14.01 


Public  Speaking 
Skills 


17.82 


Writing  Skills  5.12 

Listening  Skills  44 . 44 

Informing  25 . 06 

Persuading  7 . 57 


Demographic  Characteristics 
33.78 


Age 

Family  Support 

AFQT 


4.75 


33.33 


38.03 


College  Experience    23.83 


Military  Background 
14.71 

Paygrade  46 . 63 

Years  of  Svc . 

(Act.)  23.96 

Years  of  Svc. 

'Res.)  29.41 


Personality  Characteristics 
18.76 


Self-image 
Integrity 
Extroverted 
Sense  of  Humor 
People -Or ien ted 


14.01 


50.69 


16.43 


1.99 


16.88 


Behavior  Characteristics 


9.57 

Self-Starter 

Commitment 

Flexibi lity 

Attention  to 
Detail 

Decisiveness 


25.09 


23.92 


8.52 


18.04 


24.43 


Specific  Experience 
9.13 

Sales  Experience 


14.41 


Public  Speaking  Exp.  35 .  01 
Counselling  Exp.      50 . 58 
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Profile  of  the  Successful  Recruiter 
Expert  #6. 
Communication  Skills 


27.69 

Public  Speaking 
Skills 


1.63 


Writing  Skills 

8 

.33 

Listening  Skills 

32 

.37 

Informing 

17 

.96 

Persuading 

39 

.71 

Military  Background 

7.60 

Paygrade 

56 

07 

Years  of  Svc . 

(Act. ) 

26 

.09 

Years  of  Svc. 

(Res .  ) 

17 

.84 

Demographic  Characteristics 
9.62 

Age  10 . 99 

Family  Support  34 . 70 

AFQT  4  4.51 

College  Experience  9 . 80 


Personal ity  Character  is tic: 
26.90 


Self-image 
Integri  ty 
Extroverted 
Sense  of  Humor 
People-Oriented 


17. 

42 

35. 

81 

9 

.40 

10. 

25 

27 

.13 

Behavior  Characteristics 


22.79 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


28.39 


16.34 


28.85 


9.28 


17.13 


Specif  ic  Experience 
5.40 

Sales  Experience 


42.18 


Public  Speaking  Exp.  28 . 45 
Counselling  Exp.      29 . 38 
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Profile  of  the  Successful  Recruiter 


Expert  MAGR 

Communication  Skills 
27.71 

Public  Speaking 

Skills  8.16 

Writing  Skills      4.14 

Listening  Skills   30 . 50 


Informing 
Persuading 


25.90 


31.29 


Demographic  Characteristics 
17.33 


Age 

Family  Support 

AFQT 


2.90 


34.25 


50.97 


College  Experience    11 . 38 


Military  Background 
14.66 

Paygrade  59 . 52 

Years  of  Svc . 

(Act.)  9.67 

Years  of  Svc. 

(Res.)  30.81 


Personality  Characteristics 
16.73 


Self-image 
Integrity 
Extroverted 
Sense  of  Humor 
People -Or iented 


17.04 


53.95 


11.57 


7.37 


10.07 


Behavior  Characteristics 
13.63 

Self-Starter  30.06 

Commitment  27  .  01 

Flexibility  23.01 

Attention  to 

Detail  12 .04 

Decisiveness  7.61 


Specif  ic  Experience 
9.94 

Sales  Experience 


45.15 


Public  Speaking  Exp.  22 .  82 
Counselling  Exp.      32 . 03 
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Profile  of  the  Successful  Recruiter 
Expert  #7. 
Communciat i on  Skills 


28.28 

Public  Speaking 
Skills 

Writing  Skills 


Informing 
Persuading 


18.34 
10.57 


Listening  Skills   23 . 66 


14.12 


33.31 


Demographic  Characteristics 
9.77 

Age  3.78 

Family  Support  33 . 32 

AFQT  43  .  87 

College  Experience  18 . 54 


Military  Background 
13.70 


Paygrade 


44.32 


Years  of  Svc. 

(Act.)  32.15 

Years  of  Svc. 

(Res.)  23.52 


Personality  Characteristics 
24.99 


Self-image 
Integrity 
Extroverted 
Sense  of  Humor 
People -Oriented 


29.  50 


41.66 


17.53 


4.  46 


6.85 


Behavior  Characteristics 


17.12 


Self-Starter 

Commitment 

Flexibi li ty 

Attention  to 
Detail 

Decisiveness 


27.94 


19.23 


15.98 


24.94 


11.90 


Specific  Exper  ience 
6.13 

Sales  Experience 


20.04 


Public  Speaking  Exp.  15 .  27 
Counselling  Exp.      64.69 
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Profile  of  the  Successful  Recruiter 


Expert  #8. 

Communication  Skills 
43.65 

Public  Speaking 

Skills  20.13 

Writing  Skills     10 . 45 

Listening  Skills   29  .27 


Informing 
Persuading 


31.91 


8.25 


Demographic  Characteristics 
4.75 


Age 

Family  Support 

AFQT 

College  Experience 


32. 

56 

7. 

,78 

41. 

,  38 

13, 

.29 

Mi  li tary  Background 
3.53 

Paygrade  20 . 33 

Years  of  Svc. 

(Act.)  45.58 

Years  of  Svc. 

(Res.)  34.10 


Personality  Characteristics 
25.65 


Self-image 
Integrity 
Extroverted 
Sense  of  Humor 
People -Or  iented 


6. 

58 

35. 

,18 

12. 

.21 

11. 

,59 

34. 

,  45 

Behavior  Characteristics 


10.60 


Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decisiveness 


9.44 


35  5; 


37.95 


11.02 


6.03 


Spec  i  f ic  Exper  ience 
11.81 

Sales  Experience 


22.27 


Public  Speaking  Exp.  45.32 
Counselling  Exp.      32 . 41 
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11.11 


Public  Speaking 


Writing  Skills 


Informing 

Persuadi  ng 


Listening  Skills   2  7.17 


11.0 


46.63 


Prof:  lie  of  t h e  Sacc^:::  f  •■  1 1  Recrul  ter 
Expert  #9. 
Co mmun i  ca t  i  on  Skills 


uemoqraph ic  Character lsticu 


17.  16 


iice 


rarauy  Support 

AFQT 

Loii e < j c  ex  p  e  r  a  e n l y 


11 

G  ^ 

1 

t  t 

c  7 

9  4 

2  3  . 

7  - 

Military  Background 


Personal  i  tv  Character  1st  ic?_- 


Pa '/grade 


Years  of  Svc. 
(Res  .  ) 


o  .:  .  ii 


Years  of  Svc . 

(Act.)  23.7  3 


7.83 


29  .  62 

Sei f -Image 
Integri ty 
Extroverted 
Sense  of  Humor 
People-Oriented 


15 

5  2 

il   7- 

.  4  I 

33 

33 

20. 

96 

3 

.23 

Behavior  Characteristics 


15.20 


Self-Starter 

Commi  tment 

Flexibil i ty 

Attention  to 
Detail 

Decis  i veness 


34. 

45 

32. 

48 

3. 

3  6 

15.  64 


14  .  03 


Spec!  f  ic  Ex per i  ence 
11.60 

Sales  Experience 


4  6.95 


Public  Speaking  Exp.  32 . 54 
Counselling  Exp.      2  0.50 
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Profile  o £  the  3uccGssfi.il  S^cr'i  1  tor 


Expert  #10. 

Commun  ;  cation  Skills 
54  .  61 

Public  Speaking 
S  k ills 

Wr i  ting  Sk ills 

Listening  Skills 

Informing 

Fersuadi  rig 


■I  c 

.  s6 

5 

"j  1 

_L  _ 

.  8  2 

2  7 

.  42 

J  0 

.  9  9 

Demugrach  i  c  Cha racteri :-; tic; 


Age 

Family  Support 

AFQT 

College  Experience 


8  . 

.  8  4 

26 

.04 

4  5 

5  3 

]  g 

c  j 

Military  Background 


10.50 

Paygrade 

2  7.81 

Years  of  5^c. 

(Act. ) 

56.61 

Years  of  Svc. 
(Res  .  ) 


5.53 


Personality  Character  is t  ics 

5.36 

Sel f -Image 
Integrity 
Extroverted 
Sense  of  Humor 
Peoplo-Or iented 


14  . 

.  5  0 

53 

.  o  3 

10 

.54 

14. 

.  27 

7 

.02 

Behavior  Characteristics 


21.44 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Dec  is  iveness 


3, 

.76 

9, 

.70 

11, 

.51 

56.86 


13.13 


Speci  fie  Ex per  ience 
2.08 


Sales  Experience 


26.06 


Public  Speaking  Exp.  4  4.73 
Counselling  Exp.      29 . 16 
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Prof  i  lf>  of  the  Successful  Recruiter 
Expert  »11. 
Communication  Skills 


2  9.95 

Public  Speaking 
Skills 

Writing  Skills 

Listening  Skills   31.77 

Inf or mi ng 

Persuading 


o 

24 

12 

.36 

31 

.77 

0  6 

25 

.06 

Demograph ic  Character  1st i 


12.02 
Age 
Fa  mi ly  Support 

AFQT 


■~>   i   no 


5  .  9  7 


-5  1  i  n 


College  Experience    10.-32 


Military  Background 


07 


Pa  ygr  ad  e 


(Act. ) 


62  .  46 


21.24 


Years  of  Svc. 

(Res.)  16.29 


Personal i  ty  Characteristics 

15.47 


S  e  1  f  - 1  ma  g  e 
Integrity 
Extroverted 
Sense  of  Humor 
People-Oriented 


16 

S  8 

34 

7  5 

27 

39 

9. 

30 

11 

.63 

Behavior  Characteristics 


30.53 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Dec  is  i veness 


35 

.32 

14 

26 

15 

.53 

10  .53 


3.21 


Spec  i  f  ic  Expe  r  ience 
1 ."  9  5 

Sales  Experience 


31.25 


Public  Speaking  Exp.  31. 25 
Counselling  Exp.      37 . 50 
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Profile  of  the  Successful  Recruiter 


Expert  1*12. 

Co  rnmuni  cat  ion    Skills 
44  .  7S 


Public  Speaking 

Skills  2  3.50 

Writing  Skills  11  .  29 

Listening  Skills  12  .  35 

Informing  7.92 

Persuading  4  4.95 


Demographic  Character  ist  ics 


8.74 

Age 

14.59 

Family  Support 

3  6.13 

AFQT 

16.00 

College  Experience 

33  .13 

Mi  1 i tary  Background 
9.18 

Paygrade  11 .  40 

Years  of  Svc. 

(Act.)  81.05 

Years  of  Svc. 

(Res.)  7.55 


Personality  Characteristic; 
8.04 


Self-image 
Integr i  ty 
Extroverted 
Sense  of  Humor 
People -Or iented 


1.83 


81.21 


8  .84 


1.00 


7.07 


Behavior  Characteristics 


11.32 

Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


54  .12 


12.35 


9  .12 


20.95 


3.46 


Speci  £  ic  Experience 
17.45 

Sales  Experience 


71.47 


Public  Speaking  Exp.  19  .  24 
Counselling  Exp.       9 . 29 
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23. b^ 


Public  Speak. inq 


wr  i t ing  3k  i 1  Is 


Listening  .Skills   2  2  .  ■'  7 
Informing  1 7 . 7  3 

Persuading         4  4.02 


Profile  of  the  Successful  Recrui ter 
Expert  »13. 
Coraraun  ica  t  i  c  n  Skills 


Demoqraoh  ic  Character  1st ics 


0.63 


Age 

Fa  mi  ly  Supper 

AFQT 


.er  lence 


]_  1 

*"*  1 

*  0 

-  - 

■?  n 

n  c 

6 

q  7 

M i 1 i t a r y  Background 

10.17 

Paygrade  4_ 


Pe r sona  1  i t v  Cha  rac  t  er  i  s  t  i  c: 


Years  of  Svc. 

(Act.)  4  0.8  3 

Years  of  Svc. 

(Res.)  16.92 


Sel f -Image 
Integr  i  ty 
Extroverted 
Sense  of  Humor 
People-Oriented 


J 

— .     .  -v 

5  0 

.  4? 

27 

.26 

3 

19 

IS 

.  41 

Behavior  Characteristics 
24  .53 


Self-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


12 

.45 

50 

3  8 

13 

.61 

10.52 


13.03 


Speci  fie  Fxper lence 
7.46 

Sales  Experience  3  4.91 

Public  Speaking  Exp.  23.54 

Counselling  Exp.  41.55 
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Prof  ill 


the  Successful  R e  c r m  iter 


Expert  #14 


i  mm  u  n  l  c  a  ".ion  Skills 


1  1 


Public  Speaking 

Skills 


Listening  Skill 
Inform! ng 
Persuading 


13  . 

,  4  4 

■3  - 

.  I  3 

11, 

1     "! 

23. 

q  2 

Deinoqrapi'  ic    Char  ic 
3  .  3  0 

Age 

Family  Support 


College  Experie 


1  4  , 

9  7 

~  j 

:-  - 

c  ,1 

5  ^ 

ir 

77 

Mi  1 i tary  Eackqr curd 
8.33 


Paygrade 

Years  or  jvc. 
(Act. ) 

Years  of  Svc. 
(Res  .  ) 


DO  . 


1   5 


■<  /   -,  •> 


J  /  .  J 


6.  49 


Personal ity  Character  is t  ics 
7.43 


Self -Image 
Integri ty 
Extroverted 
Sense  of  Humor 
People -Oriented 


3  . 

4  5 

3  5  , 

.93 

32, 

.63 

16. 

,72 

6 

.17 

Behavior  Characteristics 


2  0.31 

Seif-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


25. 

,10 

33. 

,13 

9  . 

,  ""9 

21.09 


10.  34 


Speci  fie  Exper i  ence 
Sales  Experience 


Public  Speaking  Exp.  52 . 02 
Counselling  Exp.      23 . 22 


108 


P r  o  £  j  le  cj  £  t he  Successful  Recruiter 
Expert  #15. 
Communicat  i  en  Skills 


2  4.1 6 

Public  Speaking 
Ski  1 Is 


Listening  Skills 
Informing 

Persuading 


18 

.30 

c 

.32 

20 

.  n  3 

n  *, 

.  56 

3  t_ 

.  14 

Demogra^Hic  Cha '.ic^r  i  s  t 
16.70 


Age 

Family  Support; 

i  C^,  rp 
rti:  ^  i 

College  Experienci 


1 

-) 

- 

- 

4  , 

J 

c 

4 

q 

1 

r; 

J  . 

- 

- 

Military  Back around 


i  a 


Paygrade 


Years  of  Svc. 
(Act. ) 

Years  of  Svc. 
( Res . ) 


24.97 


13.20 


Personal ity  Character  i  st i 


2  2.03 


c  ,1 1  P  _  T 


Integr i  ty 
Extroverted 
Sense  of  Humor 
People -Or iented 


1  3  . 

b  l. 

5  6 

"3  n 

7. 

,35 

4. 

39 

15. 

,32 

Behavior  Characteristics 


13.31 

Self -Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis iveness 


25 

.  56 

9, 

,05 

27, 

.70 

17.3  3 


13  .  70 


Speci  f  ic  Ex per  i ence 
7.06 

Sales  Experience 


19.53 


Public  Speaking  Exp.  31. 57 
Counselling  Exp.      4  3.75 
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P  r  o  file  o  t    the  Succs  ss  f  ul  R^croit^r 


Expert  It  16. 
Communication  Skills 


4  0.13 

Publ ic  Speaking 
Ski  lis 

Writing  Skills 


?  n  n  ~> 


i.  .  J  o 


Listening  Skills   3  4.42 

Informing  7.73 

Persuading         3  4  .  6  2 


Demograph  i.c  Character  is -:  ics 

27.  24 


Age 

Family  Support 


AFQT 


lollege  Experience 


/    , 

.  —* 

■*       "1 

7  "J 

70  . 

"j  .i 

9  , 

.  7  3 

P.  (" 


Mi  1  i  tary  3ackgr-;i:nd 

11   '13 

Paygrade  2__ 

Years  of  Svc . 

(Act.)  4  4 . C  4 

Years  of  Svc. 

(Res.)  33.10 


Personality  Characteristic 


7.9  4 
Self-image 
Integrity 
Extroverted 
Sense  of  Humor 
People-Oriented 


15. 

.  31 

11  , 

.83 

61 

.78 

3. 

,93 

6. 

.60 

Behavior  Character  ist  ics 
5.66 


Seif-Starter 

Commitment 

Flexibility 

Attention  to 
Detail 

Decis  iveness 


45, 

.80 

18, 

,02 

12, 

,17 

5.39 


13.11 


Spec  i  f  ic  Exper  i  ence 
7.09 

Sales  Experience 


53.96 


Public    Speaking   Exp.    34 . 59 
Counselling    Exp.  11.46 


UO 


Pro  £  i  1-3  of  th^  Successful  Recruiter 


Expert  MR A 

Co m.nu n  i  c a  t  i  o n  S  k  ills 
43.4  4 

Public  Speaking 
Skills 

Writing  Skills 

Listening  Skills 

I  n forming 

Persuadi  nq 


14 

"7  ~i 

4 

~>  q 

2  -j 

14 

17 

4  2 

35 

4  3 

Demo graph  ic  Character  is tic 
4  .  33 


Age 

Family  Support 

AFQT 

College  Experieno 


i  n 

~>  ■) 

26 

.95 

5  0 

.75 

1  1 

r  n 

Military  Background 
7.80 


Payqrade 


Years  of  Svc 
(Res  .  ) 


4  6.15 


Years  of  Svc. 

(Act.)  49  .76 


4  .10 


Personal i ty  C h a r a c t e r  i s t i c s 

13.37 


Self -Image 
Integr i  ty 

Extroverted 
Sense  of  Humor 
People -Or  i en ted 


g  _ 

70 

50 

67 

2.  —* 

.04 

6. 

37 

8 

.  21 

Behavior  Characteristics 


13.86 

Self-Starter 

Commitment 

Flexibi 1 i ty 

Attention  to 
Detail 

Decis  iveness 


31 

.24 

26 

34 

15 

.  32 

16  .92 


8  .67 


Spec  i  f  ic  Exper  ience 
5.  54 

Sales  Experience 


34.53 


Public  Speaking  Exp.  33 .  99 
Counselling  Exp.      26.43 
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APPENDIX    B 

The  Expert   Systems;      Indices, 
Variance,   and   Mean  Squared   Error 


Expert    #1. 


Fidelity   Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq . Err 

Overall 

Profile      90.3        65.5        18.1        81.54       1.95 

Co  nun. 

Skills       83.2        66.5        41.8        77.86       4.92 

Deraog. 

Charac.      97.8        72.7        23.7        95.82       1.21 

Military 

Backg.       89.6        72.7        22.6        80.37       2.50 

Person. 

Charac.      87.1        74.0        25.2        75.96       3.10 

Behavior 

Charac.      81.7        73.0        20.9        66.79       3.01 

Specific 

Exp.  77.8        70.3        13.9        60.65       2.18 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #2. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index.      Index       Index     Explained    Sq .Err 

Overall 

Profile      86.1        80.0        78.6        74.18       9.98 

Co  nun. 

Skills       88.2        56.0        96.0        77.89      11.67 

Deraog . 

Charac.      97.5        50.0        79.4        95.16       4.37 

Military 

Backg.       97.7        34.4       111.9        95.59       5.87 

Person. 

Charac.      92.0        78.3        99.8        84.71       9.75 

Behavior 

Charac.      92.0        67.5       102.7        84.65      10.06 

Specific 

Exp.         96.1        33.8        70.4        92.39       4.85 


113 


Expert  #3 

Fidelit; 
Index 

Overall 
Profile 

89.4 

Conun. 
Skills 

94.5 

Demog . 
Charac. 

95.0 

Military 
Backg. 

91.1 

Person. 

w>tal'3C  • 

95.4 

Behavior 
Charac. 

93.9 

Specific 
Exp. 

89.4 

The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 


Fidelity   Standards    Discrim.   Variance     Mean- 
Index       Index     Explained    Sq .Err 


99.3  55.9  80.03  6.25 
43.5  82.0  89.43  6.66 

49.2  92.1  90.40  7.13 

59.4  31.2  83.08  3.21 
67.0  85.2  91.18  6.33 
65.0  53.7  88.18  4.61 

56.3  17.3  80.00  1.94 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 


Expert  #4 

Fidelity 
Index 

Standar< 
Index 

Overall 
Profile 

92.8 

59.2 

Comm. 
Skills 

90.1 

49.0 

Demog. 
Charac. 

75.4 

48.6 

Military 
Backg. 

87.0 

28.1 

Person. 
Charac. 

85.7 

80.0 

Behavior 
Charac. 

89.5 

59.0 

Specific 
Exp. 

96.6 

37.8 

•iscrim.  Variance  Mean- 
Index,  Explained  Sq . Err 

79.2  86.19  7.36 

88.0  81.35  9.50 

70.3  56.86  11.54 

69.1  75.81  8.50 
86.9                    73.60  11.16 

50.4  80.20  5.61 
61.8                   93.48  3.95 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #5. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index,      Index       Index     Expla  ined    Sq . Err 

Overall 

Profile      94.5        80.0        47.7        89.39       3.88 

Coram* 

Skills       33.4        66.0        73.2        87.26       6.53 

Demog . 

Charac.      93.6        50.0        70.7        87.70       6.20 

Military 

Backg.       96.7        50.0        66.3        93.64       4.18 

Person. 

Charac.      94.3        79.0        75.4        88.97       6.26 

Behavior 

Charac.      96.9        64.0        60.5        93.95       3.72 

Specific 

Exp.         96.5        52.3        56.2        93.19       3.67 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  86. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq .Err 

Overall 

Profile      97.9        58.0        62.2        96.02       3.10 

Coram. 

Skills       96.0        42.4        76.5        92.17       5.35 

Demog. 

Charac.      96.4        51.6       64.4        93.00       4.26 

Military 

Backg.       89.2        40.6        61.4        79.74       6.92 

Person. 

Charac.      95.6       57.0       58.5       91.50       4.27 

Behavior 

Charac.      96.9        60.5        55.6        93.91       3.43 

Specific 

Exp.         93.5        29.7        62.4        87.51       5.51 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #7. 

Fidelity   Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq . Err 

Overall 

Profile      95.9        51.4        43.7        92.08       3.08 

Coram. 

Skills       87.5        42.6        68.8        76.73       8.29 

Demog. 

Charac.      93.6        45.0        59.5        87.77       5.20 

Military 

Backg.       86.6        35.6        55.9        75.04       6.99 

Person. 

Charac.      90.8        56.9        57.6        82.48       6.03 

Behavior 

Charac.      92.8        55.0        39.7        86.24       3.68 

Specific 

Exp.         93.4        48.9        23.7        87.39       2.10 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #8. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq .Err 

Overall 

Profile      91.2        77.0        83.8        83.27       8.57 

Coram. 

Skills       87.7        45.0        74.2        76.93       8.91 

Deraog . 

Charac.      93.6        42.2       57.8        87.63       5.09 

Military 

Backg.       91.5        35.9        52.9        83.85       5.31 

Person. 

Charac.      78.3        67.0        81.4        61.33      12.65 

Behavior 

Charac.      82.4        81.6        92.4        67.90      13.09 

Specific 

Exp.         92.2        67.2        56.1        85.01       5.43 
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Expert  #9 

Fidelit; 
Index 

Overall 
Profile 

83.3 

Coram. 
Skills 

88.0 

Demoq . 
Charac. 

78.1 

Military 
Backg. 

90.4 

Person. 
Charac. 

75.4 

Behavior 
Charac. 

83.3 

Specific 
Exp. 

92.7 

The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 


Fidelity   Standards    Discrim.   Variance     Mean- 
Index      Index    Explained    Sq .Err 


62.0  69.9  69.43  9.66 

58.0  86.0  77.52  10.19 

53.1  102.8  61.04  16.05 
35.9  94.8  81.86  10.10 

63.0  92.7  56.90  15.21 

71.1  93.4  69.47  12.10 
29.8  84.9  86.07  7.92 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #10. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sa .Err 

Overall 

Profile      95.4        61.0        89.1        91.13       6.63 

Coram* 

Skills       94.6        64.0        79.9        89.49       6.47 

Deraog. 

Charac.      96.5        54.7        66.7        93.16       4.36 

Military 

Backg.       91.0        52.3        68.6        82.96       7.08 

Person. 

Charac.      94.1        79.1      100.8        88.61       8.50 

Behavior 

Charac.      96.0        66.5        84.4        92.22       5.89 

Specific 

Exp.         96.5        48.4        71.0        93.28       4.60 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  111. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index.       Index       Index     Explained    Sq . Err 

Overall 

Profile      86.7        70.0        76.0        75.34       9.44 

Coram. 

Skills       81.7        38-. 3       124.2        66.88      17.87 

Deraog. 

Charac.      95.8        32.8        74.5        91.82       5.33 

Military 

Backg.       96.3        48.4        78.1        92.76       5.25 

Person. 

Charac.      85.0        87.1        95.0        72.40      12.47 

Behavior 

Charac.      95.1        63.0        79.3        90.57       6.09 

Specific 

Exp.         97.0        31.3        85.4        94.25       5.12 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #12. 

Fidelity   Standards    Discrim.   Variance     Mean- 
Index.      Index       Index     Explained    Sq.Err 

Overall 

Profile      95.0        17.8       103.8        90.38       8.05 

Coram. 

Skills       96.6         6.9        90.3        93.37       5.81 

Deraog. 

Charac.      92.7         5.5       58.9        86.00       5.51 

Military 

Backg.       98.6        28.0        70.5        97.32       2.89 

Person. 

Charac.      98.0        30.9       121.9        96.13       6.00 

Behavior 

Charac.      96.0        20.1       101.4        92.34       7.02 

Specific 

Exp.         94.3        11.9        74.3        88.99       6.16 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 


Expert  #13. 


Fidelity   Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq .Err 


62.2  92.16  4.36 
62.1  93.59  3.93 
46.9  96.48  2.20 

46.3  80.00  5.18 
66.0  94.83  3.75 

62.0  92.11  4.41 

53.1  9U.78  4.03 


Overall 
Profile 

96.0 

55.5 

Coram. 
Skills 

96.7 

64.0 

Demog, 
Charac. 

98.2 

62.5 

Military 
Backg. 

89.4 

57.8 

Person. 
Charac. 

97.3 

73.5 

Behavior 
Charac. 

95.9 

68.0 

Specific 
Exp. 

95.2 

49.2 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #14. 

Fidelity   Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq .Err 

Overall 

Profile      88.7        84.7        82.3        78.82       9.50 

Coram. 

Skills       85.9        92.7        64.5        73.85       8.39 

Deraog . 

Charac.      96.0        82.0       114.8        92.29       8.02 

Military 

Backg.       69.1        41.6        49.5        47.83       8.94 

Person. 

Charac.      85.6       100.3        85.0        73.41      11.16 

Behavior 

Charac.      79.6       109.7       67.2       63.45      10.20 

Specific 

Exp.         86.2        31.3        62.4        74.36       7.91 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #15. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index      Index    Explained    Sq .Err 

Overall 

Profile      94.1        62.0        88.1        88.62       7.95 

Coram. 

Skills       90.7        60.6        80.7        82.32       8.48 

Deraog . 

Charac.      93.4        76.6        59.5       87.30       5.29 

Military 

Backg.       97.5        69.5        83.7        95.14       5.28 

Person. 

Charac.      93.0        69.3        78.7        86.66       7.25 

Behavior 

Charac.      92.9        58.5        61.1        86.44       5.63 

Specific 

Exp.         93.4        68.8        67.8        87.28       6.05 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert  #16. 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sa . Err 

Overall 

Profile  92.6  60.7  92.4  85.83  8.65 

Comxn. 

Skills  90.2  71.8  76.3  81.38  8.21 

Demog. 

Charac.  97.1  59.7  100.2  94.31  6.08 

Military 

Backg.  92.4  78.1  64.3  85.44  6.14 

Person. 

Charac.  93.5  47.4  98.8  87.59  6.70 

■ 

Behavior 

Charac.  92.3  57.4  84.3  85.33  7.89 

Specific 

Exp.  95.1  39.8  74.1.  90.47  5.72 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert   MftGR 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq . Err 

Overall 

Profile      97.3        73.5        40.9        94.78       2.78 

Co  mm. 

Skills       98.2        53.5        64.8        96.55       2.82 

Demog. 

Charac.      96.6        53.4        58.3        93.47       3.73 

Military 

Backg.       96.7        46.4        45.7        93.61       2.89 

Person. 

Charac.      96.2        74.0        60.9        92.62       4.14 

> 

Behavior 

Charac.      97.5        46.3        48.4        95.21       2.65 

Specific 

Exp.  96.7        46.3        38.3        93.70       2.40 
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The  Expert  Systems: 
Indices,  Variance,  and  Mean-Squared  Error 

Expert   MRA 

Fidelity    Standards    Discrim.   Variance     Mean- 
Index       Index       Index     Explained    Sq .Err 

Overall 

Profile      97.0        59.9        62.1        94.17       3.73 

Coram. 

Skills       96.5        54.8        68.1        93.21       4.31 

Deraog . 

Charac.      98.0        51.4        60.6        96.07       3.01 

Military 

Backg.       96.9        48.3        53.0        94.01       3.24 

Person. 

Charac.      97.1        67.5        66.8        94.35       3.94 

Behavior 

Charac.      96.4        65.2        53.4        92.97       3.35 

Specific 

Exp.  97.9        42.7        51.8        95.97       2.60 
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APPENDIX    C 
Attribute    ffatings    of    Hypothetical    Recruiter    Applicants 


Applicant 

Attribute 

Public  speaking 

Writing 

Listening 

Informing 

Persuading 

Age 

Family  support 

AFQT 

College  exp. 

Paygrade 

YOS  (A) 

IOS  (R) 

Self-image 

Integrity 

Extroverted 

Sense  of  humor 

People-oriented 

Self-starter 

Commitment 

Flexibility 

Attention  to 
Detail 


B 

9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 
9 


2 
8 

3 
4 
4 

7 
2 

5 
9 
7 
4 
4 
8 
4 
8 
2 
8 
7 
1 
4 


7 
3 
8 
5 
6 
5 
6 
5 
2 
5 
3 
2 
6 
7 
5 
1 
5 
6 
4 
2 


2 
6 
4 
3 
3 
5 
3 
8 
6 
6 
2 
6 
2 
3 
4 
8 
3 
2 

3 
6 


3 
7 
2 
6 
2 
6 
8 
7 
3 
8 
6 
1 
4 
2 
3 
6 
2 
8 
2 
7 


H 

4 
4 
4 
4 
4 
5 
4 
5 
4 
5 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 


6 
2 
6 
7 
8 
8 
7 
6 
7 
9 
1 
3 
7 
6 
2 

3 
6 

3 
6 
8 


8 
3 
2 
8 
7 
6 
2 
5 
2 
6 

3 

4 

3 
5 
6 
7 
7 
5 
7 
3 


130 


Appendix    C,     continued 


Applicant 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

Attribute 

Decisiveness 

1 

9 

5 

8 

2 

6 

3 

4 

7 

5 

Sales  exp. 

1 

9 

5 

4 

6 

2 

3 

4 

7 

2 

Public  speak- 

ing exp. 

1 

9 

5 

2 

1 

3 

4 

4 

8 

2 

Counselling  exp. 

1 

9 

5 

8 

1 

4 

6 

4 

2 

9 

Applicant 

K 

L 

M 

N 

0 

P 

S 

T 

U 

V 

Attribute 

Public  speaking 

2 

7 

1 

8 

6 

9 

3 

5 

4 

2 

Writing 

2 

7 

1 

8 

4 

3 

7 

2 

9 

9 

Listening 

2 

7 

8 

1 

6 

2 

9 

4 

3 

2 

Informing 

2 

7 

8 

1 

4 

4 

5 

5 

2 

9 

Persuading 

2 

7 

8 

1 

6 

9 

4 

7 

3 

2 

Age 

5 

7 

5 

5 

6 

7 

8 

9 

5 

9 

Family  support 

2 

7 

8 

1 

4 

5 

8 

3 

2 

2 

AFQT 

5 

7 

8 

1 

6 

8 

6 

5 

7 

9 

College  exp. 

2 

7 

1 

8 

4 

2 

3 

5 

1 

2 

Paygrade 

5 

7 

8 

5 

6 

6 

8 

7 

9 

9 

YOS  (A) 

2 

7 

8 

1 

4 

3 

9 

5 

6 

2 

YOS  (R) 

2 

7 

1 

8 

6 

8 

1 

2 

4 

9 

Self-image 

2 

7 

1 

8 

4 

9 

5 

5 

3 

2 

Integrity 

2 

7 

8 

1 

6 

5 

9 

2 

2 

9 
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Appendix  C,  concluded 

Applicant  KLMNOPSTUV 

Attribute 

Extroverted  2781494462 

Sense  of  humor  2718642839 

People-oriented  2781456372 

Self-starter  2781668729 

Commitment  2781439262 

Flexibility  2718625349 

Attention  to 

Detail  2     7     1     8     4     5     6,9     2     2 

Decisiveness  2718683739 

Sales  exp.  2781491822 

Public  speaking 

exp.  2718693719 

Counselling  exp. 2  7  1  8  4  1  9  2  2  2 
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